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This  research  introduces  a  new  methodology  for  simulating  construction 

operations  in  virtual  environments  using  the  personal  computer.  Due  to  the  complexity 

involved  in  most  construction  operations,  traditional  modeling  and  simulation 

techniques  fail  to  describe  the  dynamic  nature  involved  in  these  operations. 

Additionally,  their  methodologies  fail  to  describe  the  geometric  components  of 

construction  projects.   With  the  recent  advances  in  the  digital  industry,  construction 

operations  may  be  simulated  using  what  are  called  virtual  environments.  There  are 

some  attempts  in  that  direction.  Although,  these  attempts  study  the  effectiveness  and 

usefulness  of  construction  simulation  using  virtual  environments,  they  are  being  done 

within  research  institutes  and  large  construction  companies  where  very  expensive 

xii 


computer  hardware  is  used,  and  sophisticated  systems  are  developed.  As  a  resuh,  this 
technique  of  construction  simulation  still  does  not  reach  the  general  construction 
industry. 

This  research  presents  a  new  methodology  for  simulating  construction 
operations  in  virtual  environments  on  the  personal  computer  (PC).  Based  on  a  case 
study  from  the  real  construction  world,  a  virtual  environment  called  SIMCON, 
(SIMulating  CONstruction  operations),  was  developed  to  simulate  equipment-based 
construction  operations  with  real-time  user  interaction.  Additionally,  using  an  object- 
oriented  programming  (OOP)  concept,  modules  that  describe  user-machine  interaction 
were  also  developed.  Representation  of  machine  dynamics  was  also  added  to  the  virtual 
environment  in  order  to  achieve  more  realistic  simulation. 

The  work  in  this  research  should  allow  the  general  construction  industry  to 
effectively  and  economically  utilize  the  concept  of  virtual  environments  to  achieve  an 
early  insight  into  a  construction  operation.  This  should  allow  more  problems  to  be 
predicted,  more  realistic  alternatives  to  be  tested,  and  more  accurate  decisions  to  be 
made  using  a  visual,  interactive,  and  inexpensive  technique. 
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CHAPTER  1 

PROBLEM  STATEMENT  AND  RESEARCH  OBJECTIVES 
1.1  Introduction 

The  conglomerate  nature  of  the  construction  industry  imposes  difficulties  on 
designers,  construction  engineers,  construction  managers,  and  others  who  are  trying  to 
predict  what  kind  of  problems  might  appear  during  the  construction  phase  in  a  typical 
project.  It  is  well  known  that  the  construction  phase  is  the  most  difficult  and 
challenging  phase  to  operate,  control,  refine,  and  manage  within  the  construction 
industry  [Barrie  et  al.  1992].  It  is  very  difficult  and  sometimes  nearly  impossible  to 
make  significant  changes  during  the  early  stages  of  this  phase.  This  is  because  most 
construction  operations  are  generally  unique  activities  where  every  single  activity  has 
its  own  problems,  variables,  and  complexities  even  if  it  is  accomplished  in  two  similar 
projects. 

Since  describing  a  construction  process  is  difficult  due  to  the  intricate 
relationships  between  the  different  components  of  construction  projects,  it  is  virtually 
impossible  to  develop  a  modeling  system  that  can  behave  realistically  under  all  possible 
combinations  of  alternatives.  Therefore,  modeling  construction  operations  based  on 
simulation  networks  was  used  to  model  a  construction  operation  and  analyze  its 
behavior.  For  the  past  two  decades  researchers  have  demonstrated  how  these  simulation 
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techniques  could  be  used  to  model  and  simulate  construction  operations  such  as 
equipment-based  operations  (crane  operations,  earth-removing  operations,  and  material 
handling  operations).  Nevertheless,  the  construction  industry  has  been  slow  to  utilize 
this  simulation  technique  as  a  regular  analysis  and  planning  tool.  One  reason  is  the 
complexity  of  most  construction  operations;  these  simulation  techniques  were  unable  to 
describe  them.  Another  reason  is  the  complexity  involved  in  learning  simulation 
languages.  It  was  only  a  short  time  until  it  became  obvious  that  the  need  for  a  new 
technique  for  construction  simulation  is  extremely  important. 

With  the  continuous  advances  in  the  digital  industry  and  the  availability  of  many 
new  innovative  technologies,  the  construction  industry  started  to  realize  the  potential  of 
using  visual  representations  to  model  and  simulate  construction  operations.  For  nearly  a 
decade,  many  construction  firms  within  the  United  States  and  worldwide  took  special 
initiatives  to  develop  systems  for  modeling  and  simulating  construction  operations. 
These  systems  were  based  on  computer-aided  design  (CAD),  3-D  computer  graphics, 
and  computer  animation  techniques.  The  most  noticeable  and  powerful  feature  in  these 
systems  is  that  everything  is  presented  in  a  visual  format,  which  provided  a  strong  tool 
for  decision  support.  Not  only  can  the  user  see  the  consequence  of  a  decision,  but  also 
make  the  proper  adjustments  [Bell  et  al.  1990]. 

1.2  Stateofthe  Art— Virtual  Reality 

With  the  continuous  flood  of  advances  in  the  digital  industry  through  research  in 
the  area  of  computer  science,  many  innovative  technologies  on  the  PC  marketplace  were 
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bom.  Virtual  Reality  (VR),  which  became  a  media  buzzword,  is  one  of  these  new 
technologies.  This  newborn  technology  provides  an  unmatched  level  of  user-computer 
interaction,  which  makes  it  a  very  powerful  simulation  tool.  In  addition,  the  object- 
oriented  paradigm  allows  the  user  to  model  the  entire  construction  site  as  3-D  objects 
that  interact  with  each  other  and  with  the  user.  These  3-D  objects,  which  typically 
represent  the  construction  site,  building  components,  and  equipment,  can  be  represented 
in  what  is  called  a  virtual  environment.  However,  research  only  recently  investigated 
the  use  of  virtual  environments  in  construction  simulation. 

1.3  Problem  Statement 

Although  there  is  ongoing  research  in  the  United  States  investigating  the 
effectiveness  and  usefulness  of  virtual  environments  in  construction  simulation,  the 
dilemma  is  that  most  of  this  research  is  being  done  within  academic  institutes  and  large 
construction  companies.  There  are  two  reasons  for  this  dilemma.  The  first  is  the  lack  of 
knowledge  by  the  general  construction  industry  of  how  to  apply  the  technology  in 
construction  simulation.  The  second  reason  is  the  high  cost  of  applying  the  technology. 

However,  it  is  quite  surprising  that  the  revolution  in  PC  industry  did  not  have  a 
matching  impact  on  the  construction  industry.  Current  advances  in  the  PC  industry 
make  it  possible  to  build  virtual  environments,  which  may  be  used  in  construction 
simulation,  with  less  effort,  time,  and  cost.  In  fact,  this  is  the  main  reason  behind 
initiating  this  research. 
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1.4  Research  Objectives 

Two  main  research  questions  were  considered  in  this  dissertation.  First,  what 
has  been  achieved  so  far  in  construction  simulation  using  virtual  environments? 
Second,  is  it  possible  to  achieve  what  has  been  done  in  a  more  economic  way? 

It  was  apparent  from  the  beginning  that  this  area  of  research  is  still  in  its 
preliminary  stages  and  the  focus  of  research  could  have  gone  in  many  different 
directions.  Hence,  this  research  concentrated  on  presenting  a  new  methodology  for 
simulating  construction  operations  in  virtual  environments  economically  using  the 
available  technology  on  the  PC  platform.  In  order  to  achieve  this  goal,  one  objective  of 
this  research  was  to  develop  a  virtual  environment  for  simulating  equipment-based 
construction  operations  on  the  personal  computer  using  available  technology.  Another 
objective  was  to  validate  the  workability  of  the  methodology  by  applying  a  case  study 
to  the  virtual  environment. 

There  were  two  motivating  factors  for  this  research.  The  primary  motivation  is 
what  has  been  done  so  far  in  construction  simulation  using  virtual  environments  on 
expensive  computer  platforms.  It  would  provide  suitable  guidelines  for  this  research. 
The  secondary  motivation  was  the  current  PC  advances  represented  in  new  hardware 
and  software  technologies. 
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1.5  Method  to  Achieve  Research  Objectives 

In  this  research  the  basic  theory  to  be  investigated  is  that  construction  simulation 
can  be  done  visually,  interactively,  and  most  important  economically.  In  order  to 
achieve  the  research  objectives  the  research  work  was  organized  into  three  phases. 

1.5.1  PHASE  I  -  Literature  Review 

At  the  early  stages  of  this  research  a  comprehensive  literature  review  was  done 
to  explore  what  old  simulation  techniques  have  failed  in  construction  simulation. 
Therefore,  Chapter  2  introduces  the  benefits  of  construction  simulation.  Additionally,  it 
presents  current  techniques  used  in  construction  simulation,  their  origins,  their 
methodologies,  and  their  deficiencies.  The  last  section  of  Chapter  2  focuses  on 
presenting  the  latest  research  in  construction  simulation  using  the  VR  technology. 

1.5.2  PHASE  H  -  Exploration  of  the  Virtual  Reality  Technology 

Since  this  research  was  based  solely  on  a  new  technology,  the  second  phase  of 
the  research  concentrated  on  understanding  the  basic  theories  required  to  apply  virtual 
environments  in  construction  simulation.  Moreover,  an  investigation  on  the  available 
research  experimental  tools  was  also  conducted.  In  this  phase,  the  general  focus  was  on 
achieving  the  research  objectives  with  minimum  tools. 

Since  building  a  virtual  environment  depends  on  real-time  computer  graphics. 
Chapter  3  provides  the  necessary  theoretical  background  information  required  for 
developers  to  understand  the  technical  mechanism  of  virtual  environments. 
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Chapter  4  introduces  the  two  graphical  simulation  techniques  in  construction 
simulation:  simulations  based  on  non  real-time  computer  graphics,  and  simulation  based 
on  real-time  computer  graphics.  In  addition,  Chapter  4  presents  current  new 
technologies  that  support  the  economical  use  of  virtual  environments  in  construction 
simulation. 

Chapter  5  provides  an  overview  on  the  WorldUp^  development  environment, 
which  was  used  to  develop  the  virtiaal  environment  named  SIMCON  (SIMulating 
CONstruction  operations)  presented  in  this  research.  It  focuses  on  presenting  the 
general  background  information  necessary  to  understand  the  WorldUp  development 
environment  allowing  others  to  utilize  the  VR  technology  in  construction  simulation. 

1.5.3  Phase  III  -  Methodology  Development  and  Validation 

Based  on  the  information  gained  from  the  first  two  phases,  SIMCON  was 
developed  to  simulate  equipment-based  construction  operations.  During  this  phase, 
CAD  was  heavily  involved  in  developing  3-D  models  representing  the  construction  site, 
the  building  components,  and  the  different  equipment  prototypes  of  the  case  study. 

Additionally,  the  object-oriented  paradigm  was  applied  in  order  to  build  the 
different  components  of  SIMCON.  Since  the  nature  of  the  WorldUp  software  requires 
the  developer  to  write  a  scripting  code  to  create  visual  simulations,  scripting  modules 
describing  the  dynamic  nature  of  each  equipment  prototype  were  developed. 

Similarly,  scripting  modules  required  to  facilitate  user-machine  control  were 
also  developed.  Chapter  6  presents  the  research  methodology  using  a  case  study  from 


real  world.  This  chapter  should  provide  the  necessary  guidelines  required  by  other 
developers  who  intend  to  do  more  research  in  the  same  area. 

Chapter  7  presents  a  conclusion  from  the  research,  as  well  as  introduces  some 
possible  topics  for  future  research  in  the  same  area.  Figure  1-1  illustrates  the  research 
development  flowchart. 


WorldUp  is  a  registered  trademark  of  SenseS  Corporation. 


Literature  Review 


State  of  the  Art  -  Virtual  Reality 


Methodology  Development  & 
Demonstration 
[Development  of  SIMCON  using 
the  Case  Study] 


Construction  Simulation  using 
Simulation  Networks 


Construction  Simulation  based  on  non 
Real-Time  Computer  Graphics 


Construction  Simulation  based  on 
Real-Time  Computer  Graphics 


Development  of  3D  CAD  Models 


Development  of  Equipment  Script  Modules 


Figure  1-1:  The  research  development  flowchart. 


CHAPTER 2 
LITERATURE  REVIEW 

2.1  Introduction 

Construction  projects  are  accomplished  in  three  phases  as  illustrated  in  Figure  2- 
1.  The  design  process  is  the  first  phase,  and  the  bidding  process  is  the  second  phase. 
Construction  is  the  actual  implementation  phase. 


Figure  2-1 :  Phases  of  construction  projects. 
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It  might  appear  that  the  construction  process  is  a  systematic  process  well  defined 
within  the  construction  industry.  However,  one  of  the  most  critical  questions 
confronted  by  a  construction  engineer  is  what  construction  technique  should  be 
selected?  [Opdenbosch,  1994].  Unlike  manufacturing  processes,  construction 
operations  are  unique  activities  in  every  project,  and  a  large  number  of  factors  affects 
them  during  the  construction  process  [Opdenbosch  et  al.  1995].  This  is  due  to  the 
dynamic  nature  of  the  construction  process  itself. 

2.2  The  Need  for  Construction  Simulation 

Large-scale  structural  failure  is  a  nightmare  that  haunts  the  construction  industry 
every  day.  According  to  the  National  Safety  Council  (NSC),  an  average  of  about  2500 
persons  were  killed  and  218,000  injured,  yearly,  in  construction  accidents  during  the 
period  1977-1987  in  the  United  States  [Kaminetzky,  1991]. 

Research  shows  that  most  structural  failures  during  the  construction  phase 
resulted  from  gross  errors  or  omissions  by  designers  or  constructors  [Carper,  1987]. 
Therefore,  only  proper  training  and  education  may  effectively  control  them. 

Another  reason,  for  a  catastrophic  failure,  is  a  lack  of  communication. 
Sometimes  a  defective  detail  may  cause  a  devastating  collapse.  The  collapse  of  the 
Hyatt  Regency  walkway  in  Kansas  City,  which  was  triggered  by  improper  connection 
details,  is  one  of  many  examples.  Often  well-designed  and  carefully  executed  structures 
fail  as  a  result  of  sloppy  drafting  [Kaminetzky,  1991]. 
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Similarly,  research  on  hundreds  of  accidents  has  produced  four  distinct  accident- 
prone  situations  during  construction  [Kaminetzky,  1991].  First,  a  temporary  structure 
fails  during  construction.  Second,  workers  and  materials  or  workers  and  equipment 
come  into  contact.  Third,  workers  follow  unsafe  practices  or  perform  an  operation  with 
negligence.  Finally,  an  operation  involves  hazardous  materials.  Most  of  these  accident 
types,  which  could  be  related  to  scheduling  and  plarming  of  operations,  safety,  and 
training,  have  much  in  common.  All  of  them  occur  during  the  construction  process. 

23  Construction  Simulation  Using  Simulation  Networks 

Not  only  can  experience  avoid  problems  during  the  construction  phase,  but  early 
prediction  of  these  problems  during  the  design  phase  can  also  minimize  them.  One  of 
the  most  effective  methods  of  minimizing  construction  problems  uses  advanced 
deterministic  analysis  tools  [Kaminetzky,  1991].  However,  the  complex  and  subtle 
interactions  between  the  different  resources  involved  in  a  construction  operation  can  be 
analyzed  only  crudely  using  deterministic  analysis. 

Since  the  nature  of  any  process  in  our  real  life  has  a  stochastic  behavior,  more 
than  five  decades  ago  these  deterministic  analyses  were  done  manually  [Barrie  et  al. 
1992].  Then,  more  than  two  decades  ago,  researchers  determined  that  construction 
simulation  (using  simulation  networks)  can  assist  construction  engineers  in  making 
decisions  related  to  construction  operations. 
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2.3.1  Background 

In  late  1960s  researchers  started  to  recognize  the  need  for  simulation  techniques 
in  modeling  and  analyzing  construction  operations.  They  started  to  investigate  the  use 
of  simulation  systems  based  on  techniques  derived  from  other  areas  like  manufacturing 
in  modeling  and  analyzing  many  construction  operations. 

One  of  the  best  icnown  is  GPSS^  (General  Purpose  System  Simulator), 

developed  in  the  1960s  by  IBM^  and  now  marketed  in  microcomputer  versions.  At  the 
same  time  another  package,  called  SLAMSystem,  was  also  developed.  The  first  person 
to  investigate  the  use  of  simulation  networks  for  modeling  construction  operations  was 
Halpin,  in  his  Ph.D.  thesis  [Halpin,  1973].  Halpin  adapted  the  GERTS  (Graphical 
Evaluation  and  Review  Technique)  technique  to  develop  a  methodology,  named 
CYCLONE,  for  simulating  construction  operations.  GERTS,  which  is  a  series  of 
programs  developed  by  Pritsker  and  co-workers,  was  designed  to  analyze  networks  with 
stochastic  and  logical  properties  [Vanegas  et  al.  1994]. 

As  the  CYCLONE  system  gained  attention.  Learning  Systems  Incorporated  used 
its  methodology  to  develop  a  PC  version,  named  MicroCYCLON.  Since  then,  many 
college  construction  programs  have  used  MicroCYCLONE  in  developing  simulation 
models  for  many  equipment-based  construction  operations  such  as  crane  operations, 
earth-removing  operations,  and  material  handling  operations. 


GPSS  (General  Purpose  System  Simulator)  is  a  registered  trademark  of  IBM. 
IBM  is  a  registered  trademark  of  International  Business  Machines,  Inc. 
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Similarly,  in  1993  Huang  developed  a  program,  named  DISCO  (Dynamic 
Interface  for  Simulation  of  Construction  Operations),  to  serve  as  both  a  preprocessor 
and  postprocessor  for  the  MicroCYCLONE  program  [Huang,  1994]. 

Although,  works  in  the  Macintosh  environment  developed  few  simulation 
programs,  in  the  1960s  Jay  Forester  developed  a  package  called  Dynamo  at  MIT.  Then 
High  Performance  Systems  adopted  Forester's  work  in  developing  a  program  called 
Stella  II.  A  few  years  after  Forester's  work,  a  computer  company  named  Imagine  That 
Inc.  developed  another  program  called  Extend.  This  program  was  powerful  in  its 
modeling  capabilities  since  it  used  a  built-in  programming  language,  which  is  somewhat 
like  C.  However,  it  was  difficult  to  use. 

In  the  late  1980s  Caterpillar  Inc.,  one  of  the  largest  manufacturers  of  heavy 
equipment,  developed  a  program  called  VEHSIM,  a  simulator  for  earth  moving  vehicle 
performance  under  realistic  conditions.  Unlike  the  previously  mentioned  programs, 
VEHSIM  methodology  was  based  on  a  deterministic  approach  and  not  a  stochastic  one. 
This  means  that  the  simulator  is  based  on  the  machine  characteristics,  not  generated 
from  random  numbers. 

2.3.2  Deficiencies 

The  most  persistent  criticism  in  construction  simulation  using  simulation 
networks  is  that  the  technique  is  based  on  modifications  and  extrapolations  of 
simulation  procedures  developed  in  the  area  of  manufacturing,  which  is  different  in 
many  ways  than  the  area  of  construction.    A  simple  comparison  between  the  two 
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industries  will  clarify  why  these  simulation  techniques  are  inappropriate  for 
construction  simulation  [Oloufa,  1992]. 

In  manufacturing,  a  process  flows  from  one  phase  to  another  and  the  entire 
process  remains  the  same.  On  the  other  hand  during  construction,  construction 
operations  are  affected  and  changed  according  to  the  project  schedule.  In  general,  while 
manufacturing  processes  do  not  modify  the  system  layout  or  resource  distribution, 
construction  operations  influence  the  layout  and  resource  distribution  of  the  entire 
system.  This  is  the  most  fundamental  difference  between  manufacturing  processes  and 
construction  operations. 

Additionally,  while  manufacturing  processes  could  be  modeled  and  simulated 
using  random  numbers,  construction  operations  cannot.  In  a  real  construction  project, 
planners  have  to  determine  which  machine  to  use  in  every  operation.  This  decision 
affects  the  fate  of  the  entire  project  [Rodriguez,  1992].  In  fact,  the  ability  to  choose  a 
machine  is  lost  when  a  construction  simulation  model  is  developed  without  allowing 
users  to  test  different  alternatives.  The  important  specifications  and  characteristics  of 
construction  equipment  vanish  when  these  machines  are  modeled  with  distributed 
random  numbers  to  represent  the  duration  of  the  tasks  they  perform. 

Another  difference  between  manufacturing  processes  and  construction 
operations  is  space.  Simulation  networks  may  provide  the  logical  relationship  between 
the  different  resources  in  a  manufacturing  process.  Consequently,  they  can  not  be  used 
to  represent  the  spatial  relationship  between  resources  in  a  construction  operation.  In 
other  words,  they  fail  to  include  the  geometry  and  shape  of  construction  projects,  which 
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are  undoubtedly  important  factors  in  influencing  any  construction  operation  [Oloufa, 
1992].  These  two  factors  were  ignored  because  original  simulation  methodologies  were 
not  designed  to  take  geometry  and  shape  into  account.  Many  researchers  suggested  that 
traditional  simulation  languages  and  packages  should  support  the  geometry  and 
dynamics  of  machines.  These  two  factors  play  an  important  role  in  the  outcome  of 
construction  operations,  so  construction  plarmers  and  designers  get  a  more  realistic 
feedback  from  the  simulation  analysis  when  these  two  factors  are  accounted  for  [Oloufa, 
1992]. 

Although  the  use  of  simulation  networks  in  construction  simulation  has  opened 
the  door  for  more  research,  many  deficiencies  remain.  First,  the  technique  does  not 
provide  any  representation  of  the  construction  site,  the  different  building  components, 
or  the  dynamics  involved  in  equipment-based  operations.  These  elements  are  essential 
factors  to  the  construction  process.  Second,  the  methodology  of  this  type  of  simulation 
does  not  recognize  the  change  in  the  system  once  the  simulation  is  started.  The  only 
possible  way  the  user  can  make  changes  is  to  wait  until  the  simulation  cycle  is 
terminated.  This  is  a  strong  obstacle  in  providing  a  more  interactive  simulation.  Third, 
this  kind  of  simulation  is  time-consiuning  and  tedious,  since  it  requires  a  user-update  to 
test  every  possible  alternative.  As  a  result  of  these  deficiencies,  this  type  of  simulation 
was  only  tested  in  many  construction  colleges;  it  was  never  applied  in  the  construction 
industry. 
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2.4  Construction  Simulation  Using  Computer  Graphics 

With  the  availability  of  many  new  hardware  and  software  computer 
technologies,  construction  simulation  used  computer  graphics  and  animation 
techniques.  This  type  of  graphic  simulation  went  through  two  stages.  The  first  phase 
provided  simulations  by  animating  2D  CAD  models  on  the  computer  screen.  These  2D 
CAD  models  presented  a  construction  site,  the  building  structure,  and  the  machine 
involved  in  the  operation.  In  the  second  stage,  as  computers  got  much  faster,  these 
models  were  presented  as  3-D  objects. 

Using  this  technique  of  simulation  there  was  no  better  way  to  do  it,  the 
technique  depends  solely  on  the  hardware,  the  software,  and  the  person  who  is  doing  it. 
Figure  2-2  presents  the  technique  used  in  this  kind  of  simulation.  Since  this  technique 
depends  on  the  expert  doing  it  and  the  technique  is  using  [Ditlinger  et  al.  1989],  the 
methodology  presented  here  is  a  very  general  one. 

Generally,  a  simulation  for  a  process  can  be  done  in  stages.  The  first  stage 
involves  CAD  to  build  the  3-D  models  representing  the  different  objects  of  the  process. 
Once  the  CAD  models  are  built,  the  second  stage  involves  the  use  of  a  package  for 
computer  graphics  to  add  the  desired  graphic  attributes  to  these  models  (such  as  colors, 
shades,  or  textures).  As  advances  in  computer  graphics  are  increasing  every  day, 
graphics  programs  became  more  available  and  useable  even  on  the  home  desktop 
computers.  Therefore,  this  stage  could  be  done  on  the  personal  computer. 

Once  the  desired  colors,  shades,  and  textures  are  added  to  the  models,  the  next 
step  involves  the  use  of  a  computer  animation  program.    Computer  graphics  and 
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animation  programs  are  the  heart  of  the  simulation  itself  and  determine  how  it  will  look. 
An  animation  package  with  many  advanced  features  tends  to  generate  more  realistic 
simulations. 


Model  generation  using  CAD 


Model  update  using  computer 
graphics 


Model  update  using  computer 
animation 


Graphical  Simulation 


Figure  2-2:  The  graphical  simulation  technique. 

2.4.1  Example 

An  example  of  recent  products  representing  3-D  graphical  simulations  in 
construction  engineering  is  Bechtel's  Construction  CAE,  integrated  with  Jacobs 
Technology's  Simulation  Session  Manager  [Paulson,  1995].  The  integration  of  both 
programs  adds  time-base  to  the  generated  simulation.    Once  the  schedule  of  an 
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operation  is  finished,  the  program  shows  how  the  components  are  installed  over  time. 
The  system  basic  elements  include  (1)  a  preprocessor  to  transfer  information  from  a  3-D 
CAD  program  to  Construction  CAE,  (2)  a  library  of  models  for  many  equipment 
prototypes,  (3)  a  CPM  scheduling  program,  (4)  the  simulation  planner;  and  (5)  a  scope- 
control  database.  Moreover,  the  system  has  many  capabilities,  such  as:  the  ability  to 
model  construction  openings,  the  ability  to  display  material  handling  equipment,  the 
ability  to  include  temporary  facilities,  and  the  ability  to  provide  multiple  views 
[Paulson,  1995].  The  output  of  the  system  includes  (1)  graphical  CPM  schedules;  (2) 
animated  videos  of  some  construction  operations;  and  (3)  tabular  schedule  and  resource 
reports  [Paulson,  1995]. 

2.4.2  Current  Criticisms 

The  first  criticism  of  this  type  of  construction  simulation  based  on  computer 
graphics  is  that  there  is  no  enough  guidelines  on  how  to  apply  the  technique  in 
construction  simulation  using  the  PC.  Systems  developed  in  this  area  were  key 
components  in  the  success  of  companies  that  developed  these  systems,  and  they  played 
an  important  role  as  a  powerful  management  tool  as  well  as  being  strong  selling  tools. 
As  a  result,  no  company  has  developed  these  programs  for  commercial  use,  and  the 
general  construction  industry  never  was  able  to  apply  them. 

The  second  criticism  in  construction  simulation  is  cost.  Although  many 
companies  in  the  United  States  started  to  develop  their  custom-made  computer  aided 
design  and  architectural  walk-through  programs,  the  majority  of  the  construction 
industry  never  took  the  chance  to  apply  these  programs  in  their  construction  projects. 
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Until  recently,  the  software  available  for  construction  simulation  has  not  been  readily 
available  at  reasonable  cost  for  today's  low-cost  computers  [Paulson,  1995]. 

The  third  criticism  in  construction  simulation  is  the  lack  of  real-time  user- 
interaction,  which  is  extremely  important  in  training  applications.  Since  construction 
errors  are  so  expensive,  training  is  a  very  important  issue  in  construction  simulation 
[Opdenbosch  et  al.  1991].  Training  provides  the  ability  to  put  a  trainee  in  a  situation 
similar  to  a  real  world  situation,  and  provides  the  opportunity  to  test  different 
alternatives  and  strategies.  However,  current  techniques  in  construction  simulation, 
based  on  non  real-time  computer  graphics  and  animation,  prevent  it  from  being  an  ideal 
learning  and  training  tool. 

Even  though  the  usefulness  of  computer  animation  has  been  proven  many  times 
in  construction  simulation  (like  in  Bechtel's  example),  it  cannot  be  used  for  real-time 
simulations  which  are  extremely  important  in  training  applications  [Kangari  et  al. 
1991].  This  is  because  computer  animation  provided  neither  the  speed  nor  the 
flexibility  required. 

In  order  to  avoid  confiision  in  this  area,  the  term  "computer  animation"  must  be 
defined  clearly.  This  term  refers  to  a  sequence  of  previously  computed  graphical 
scenes.  This  term  is  different  than  real-time  computer  simulations  [Opdenbosch,  1992], 
which  are  computed  in  real-time  so  that  as  simulation  scenes  are  modified  or  altered, 
changes  take  place  immediately  on  the  screen. 
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2.5  Construction  Simulation  Using  Interactive  Computer  Graphics 

2.5.1  Background 

In  1976,  Hurrion  was  the  first  person  to  conceive,  in  his  Ph.D.  thesis,  of 
combining  computer  graphics  and  user  interaction.  As  a  result,  the  evolution  of  the 
Visual  Interactive  Simulation  (VIS)  technique  began  [O'Keefe,  1987].  Later  Hurrion 
developed  SIMON,  a  simulation  language  to  support  VIS.  His  first  package  was  called 
VISION,  which  was  further  modified  to  allow  more  flexibility  in  user-simulation 
interaction  [Bell  et  al.  1987]. 

By  the  late  1970s  simulation  packages  were  extended  to  a  variety  of  graphical 
modes  and  customizable  icons,  to  represent  the  machines  and  entities  that  interact  in  the 
system.  With  advances  in  computer  technology,  companies  improved  the  input  and 
modeling  capabilities  of  VIS  giving  the  birth  to  VIM  (Visual  Interactive  Modeling) 
[Bishop  etal.  1990]. 

The  fu^t  application  which  let  the  user  define  the  simulation  model  while  the 
simulation  was  running  was  OPTIK,  dated  back  1982  [Bell  et  al.  1987].  With 
continuous  improvements  in  VIS  and  VIM,  simulation  systems  started  to  be  used  as 
modeling,  simulation,  and  decision  support  systems  [Opdenbosch,  1994]. 

2.5.2  VIS  Methodology 

O'Keefe  defined  VIS  as  a  simulation  system  that  is  visually  capable  of  analyzing 
a  real  life  process  [O'Keefe,  1987].  The  main  building  blocks  of  VIS  are  visual  input, 
visual  output,  and  user-interaction. 
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2.5.2.1  Visual  input 

Through  visual  input  a  model  can  be  modeled  visually  rather  than  being 
programmed  or  data-given.  Two  formats,  an  Iconic  representation  and  a  Graphical 
representation,  provide  visual  input  to  the  simulation  system  [O'Keefe,  1987].  With  the 
advances  happening  daily  in  the  computer  industry,  these  two  forms  of  input  to  a 
simulation  system  take  many  advanced  forms  such  as:  two-dimensional  and  three- 
dimensional  representations  of  the  process  and  the  relevant  objects  participating  in  it. 

2.5.2.2  User  interaction 

The  user  can  interact  with  the  model,  analyze  its  behavior  and  make  decisions  at 
any  given  time  during  the  simulation  cycle.  Similarly,  there  are  three  ways  for  user- 
simulation  interaction.  First,  with  Embedded  Programming,  the  user  pre-programs  the 
simulation  system  to  allow  human  interaction  at  a  given  state  of  the  simulation  or  at  a 
given  time.  Second,  by  using  Standard  Interactions,  the  system  provides  a  set  of 
standard  user  determined  interactions.  The  third  way  is  less  used  among  this  kind  of 
simulation  because  it  requires  the  user  to  stop  the  simulation  and  proceed  once  he 
finishes  the  interaction  session  with  the  system  [O'Keefe,  1987]. 

2.5.2.3  Visual  output 

Visual  output  presents  analysis  results  to  the  user  in  visual  format  rather  than  a 
text-oriented  one.  Three  approaches  are  commonly  used  to  facilitate  the  display  of  the 
dynamic  behavior  of  an  operation  in  visual  output.  First,  through  what  is  called 
Embedded  Programming,  the  user  controls  the  output  of  the  simulation  through 


22 

programming  statements.  Second,  Automatic  Display  is  commonly  used  in  the  type  of 
simulation  where  the  user  pre-defines  the  format  of  the  visual  display,  and  as  the 
behavior  changes  it  displays  the  results  accordingly.  Third,  by  using  computer 
animation,  an  approach  which  is  more  representative  of  changes  in  behavior,  the 
simulation  automatically  produces  a  formatted  statements  representing  the  output, 
which  is  then  passed  and  decoded  by  the  animator  [O'Keefe,  1987]. 

A  consistent  argument  among  researchers  about  VIS  is  whether  or  not  it  is  better 
than  non-graphical  simulation.  When  it  comes  to  construction  operations,  a  graphical 
simulation  tool  is  essential.  This  is  due  to  the  fact  that  the  geometric  characteristics, 
specifications,  and  machine  dynamics  play  an  important  role  in  the  results  of  a 
construction  operation,  and  there  is  no  other  way  rather  than  using  computer  graphics  to 
involve  these  factors  in  the  simulation  process  [Oloufa,  1992]. 

2.5.3  Advantages 

Since  the  methodology  involved  in  the  VIS  technique  emphasizes  user 
interaction,  the  user  can  quickly  become  familiar  with  the  system.  In  addition,  its  visual 
output  format  greatly  increases  the  credibility  of  the  model.  As  a  result,  clients  and 
others  can  easily  understand  the  model  behavior  by  following  the  dynamic  display 
[O'Keefe  et  al.  1991].  "It  is  generally  accepted  that  where  clients  can  follow  a  dynamic 
display  of  the  model,  credibility  is  far  greater.  A  client  need  no  longer  accept  the 
developer's  word  that  the  model  is  in  some  sense  valid.  In  many  organizations,  clients 
will  no  longer  accept  the  use  of  a  simulation  that  does  not  provide  visual  output 
[O'Keefe,  1987]."  Another  major  advantage  of  using  VIS  is  learning.  In  addition  to 
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being  used  as  an  analysis  tools  and  decision  making  support,  VIS  has  the  potential  to 
instruct  others  on  the  model's  behavior  visually.  According  to  O'Keefe,  learning  is  one 
of  the  major  advantages  of  using  VIS  in  construction  simulation,  because  it  increases 
the  client's  understanding  of  the  behavior  of  an  operation  to  a  great  extent  [O'Keefe, 
1987]. 

2.6  Virtual  Environments  in  Construction  Engineering 

By  taking  a  closer  look  at  the  methodology  of  the  VIS  technique,  researchers 
have  realized  the  potential  of  using  VR  in  construction  simulation.  Since  the  VR 
technology  is  based  upon  real-time  computer  graphics,  it  provides  a  superior  level  of 
visual  input,  visual  output,  and  real-time  user  interaction. 

2.6.1  Background 

Virtual  Reality  is  a  relatively  new  technology  by  which  a  user  can  step  into  a  3- 
D  simulated  world.  It  is  not  necessary  for  this  simulated  world  to  describe  a  real 
process  or  one  created  in  the  user's  mind.  The  term  Cyberspace,  which  refers  to  this 
technology  was  first  introduced  by  William  Gibson's  science  fiction  novel, 
"Neuromance",  published  in  1984  [Pimentel  et  al.  1995].  His  term  described  a  3-D 
computer-generated  world  representing  a  set  of  data  which  enables  the  user  to  step 
inside  it.  This  3-D  virtual  environment  often  came  to  be  described  as  the  science  of 
integrating  human  with  information.  Literature  on  VR  reveals  that  the  technology  was 
bom  from  the  merging  of  many  disciplines  including  psychology,  cybernetics,  computer 
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graphics,  data  base  design,  real-time  and  distributed  systems,  electronics,  robotics  and 
multimedia. 

In  mid  1960s,  Ivan  Sutherland  presented  a  paper  called  "The  Ultimate  Display", 
in  which  he  described  the  concept  of  a  head-moimted  display  system  [Sutherland, 
1965].  Sutherland  also  stated  that  the  illusion  presented  to  the  user  should  "look  real, 
act  real,  sound  real,  and  feel  real".  Three  years  later  he  demonstrated  the  first  ever 
working  head-mounted  display  [Sutherland,  1968], 

2.6.2  Applications  of  Virtual  Environments 

Virtual  environments  are  becoming  key  component  simulation  tools  in  many 
applications  such  as  defense,  medicine,  aerospace,  industrial  engineering,  robotics  and 
automation,  and  chemical  engineering.  The  following  literature  focuses  on  VR 
applications  related  to  building  design  and  construction  engineering. 

2.6.2.1  Training 

One  of  the  areas  in  which  a  virtual  environment  has  a  strong  impact  is  training 
simulations,  because  it  allows  people  to  interact  with  things  in  a  natural  manner,  which 
improves  their  natural  abilities.  In  most  engineering  disciplines  training  can  be 
impractical,  dangerous,  and  sometimes  nearly  impossible.  In  addition,  construction  is 
one  area  in  which  training  can  be  very  expensive,  especially  in  training  a  worker  on  a 
special  piece  of  equipment.  Since  building  virtual  environments  replaces  any  physical 
modeling,  the  concept  can  be  an  inexpensive  solution  to  train  individuals  before  they  are 
ever  put  in  the  real  situation  [Warwick  et  al.  1993].  A  good  example  is  Caterpillar  Inc., 
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the  largest  manufacturer  of  heavy  equipment,  which  uses  virtual  environments  in  testing 
new  equipment  prototypes  rather  than  spending  hundreds  of  thousands  in  building 
physical  prototypes. 

2.6.2.2  Concept  design 

Quality  assurance,  as  "one  of  the  most  important  themes  of  software 
engineering"  [Jones,  1990],  consists  of  verification  and  validation.  Virtual 
environments  offer  the  most  realistic  way  of  prototyping  through  verification  and 
validation  of  the  model.  Functional  correctness  checks  verify  the  model,  and  testing  the 
model  against  the  requirement  analysis  can  do  validation. 

2.6.2.3  Computer  Aided  Design  CAD 

In  the  late  1960s,  attempts  were  made  to  model  building  components  and  to 
automate  the  design  and  evaluation  of  projects.  Development  continued  through  the 
1970s  and  culminated  in  systems  such  as  OXSYS,  TechCrete,  and  SHSS  [Hoskins, 
1972].  The  main  features  of  these  systems  were  that  they  took  a  design  fi*om  a 
conceptual  sketch,  through  the  process  of  assigning  components  and  into  the  production 
of  working  drawings.  Unfortunately,  the  computer  technology  at  that  time  could  not 
cope  with  the  storage  and  the  speed  requirements  to  store  the  geometric  characteristics 
of  building  components  as  well  as  analyzing  and  processing  them  [Distefano  et  al. 
1972].  The  exception  to  these  systems  was  OXSYS,  which  was  evolved  into  a 
successfiil  commercial  CAD  system  by  McDonnell  Douglas  Information  Systems. 
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In  mid  1980s,  researchers  at  the  Departments  of  Architectural  and  Civil 
Engineering  of  Carnegie-Mellon  University  developed  an  integrated  software 
environment,  called  IBDE,  which  catered  to  the  design  of  multi-story  framed  buildings 
[Adeli,  1988].  The  methodology  used  to  develop  IBDE  was  so  successftil  that  it 
allowed  IBDE  to  be  a  usefiil  testing  media  for  investigating  the  implementation  issues 
associated  with  general-purpose-computer-aided  building  design  tools. 

2.6.2.4  Construction  simulation 

One  of  the  areas  in  which  VR  was  investigated  is  the  area  of  construction 
engineering.  Although  there  is  no  clear  information  about  when  and  where  it  actually 
began  in  construction  engineering,  some  of  the  early  work  done  in  late  1970s  started  in 
the  United  Kingdom. 

The  Department  of  Construction  Management  and  Engineering  at  the  University 
of  Reading  developed  a  3-D,  computer-aided  building  design  tool,  called  CABD,  which 
allowed  the  creation  and  manipulation  of  solid  models  representing  building 
components  [Warwick  et  al.  1993].  Following  that  work,  the  Cybernetics  Virtual 
Reality  Research  Group  in  Reading  University  created  a  fially  immersive  virtual  reality 
interface  which  can  be  used  to  walk  through  building  designs  developed  on  CABD 
[Warwick  et  al.  1993]. 

In  1994  in  the  U.S.  a  program  called  the  Interactive  Visualizer  Plus  Plus  (IV-H-) 
was  developed  to  model  building  components  and  simulate  construction  operation  at  the 
Georgia  Institute  of  Technology  by  Opdenbosch  [Opdenbosch,  1994].  In  his  Ph.D. 
thesis  Opdenbosch  presented  a  new  way  to  model  and  simulate  construction  operations 
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in  virtual  environments.  The  key  element  in  the  IV-h-  methodology  was  to  utilize  real- 
time computer  graphics  in  the  simulation  using  virtual  environments.  Additionally,  the 
IV++  provided  a  new  way  of  user-simulation  interaction  by  allowing  the  user  to 
participate  in  the  3-D  computer-generated  environment.  Moreover,  a  new  technique 
called  Computer  Aided  Design  and  Assembly  (CADA)  was  developed  in  the  IV-H-, 
which  automates  the  process  of  simulating  building  construction  [Opdenbosch,  1994]. 

2.6.3  Benefits  of  Using  Virtual  Reality  in  Construction  Engineering 

The  human  sensory  system  was  created  to  interpret  information  needed  for 
survival.  In  the  modem  world,  the  human  needs  are  different  in  many  ways.  From  an 
engineering  point  one  important  need  is  to  understand  clearly  the  tremendous  amount  of 
information  that  deals  with  managing  an  operation  every  moment.  A  virtual 
environment  can  easily  allow  the  user  to  map  this  information  to  his  well-developed 
sensory  organs.  In  the  area  of  construction,  during  the  actual  construction  phase  of  any 
project,  we  need  to  process,  analyze,  and  interpret  an  overwhelming  number  of  data. 
Having  the  construction  site,  a  machine,  and  other  resources  in  a  3-D  computer 
generated  virtual  environment  can  help  to  a  great  extent  in  understanding  the  different 
parameters  affecting  the  construction  process  [Rodriguez,  1992].  The  question  is 
whether  the  current  technology  is  capable  of  facilitating  that  to  the  user  or  not? 
Although  there  are  no  definite  answers  to  this  question,  how  well  the  user  needs  to 
perceive  information  using  a  virtual  environment  depends  solely  on  how  affordable  the 
technology  is. 


28 

With  current  advances  in  the  computer  industry,  a  virtual  environment  has 
powerful  potential  if  used  as  an  analysis  and  testing  tool  to  guide  our  decisions 
[Pimentel  et  al.  1995].  With  the  availability  of  advanced  computer  systems  that  are 
capable  of  processing  photo-realistic  3-D  images,  virtual  environments  that  describe 
natural  phenomena  or  real  processes  can  be  generated,  described,  analyzed,  and  most 
importantly  interpreted. 

In  addition,  human-machine  interaction  is  becoming  much  easier  and  less 
expensive  due  to  the  flood  of  many  of  new  technologies  available  in  software 
engineering.  The  advantage  of  using  virtual  environments  in  construction  can  be 
greatly  realized  in  training  and  operations  simulations.  Similarly,  virtual  environments 
can  help  designers,  construction  managers  and  others  to  share  their  ideas  and  make 
decisions  more  quickly.  As  a  result,  they  can  focus  on  design-related  as  well  as 
construction-related  issues  rather  than  finding  solutions  to  exchange  their  ideas  and 
knowledge  [Loeffler  et  al.  1994]. 


CHAPTER  3 

BASIC  PRINCIPLES  IN  COMPUTER  GRAPHICS 


3.1  Introduction 

This  chapter  presents  basic  principles  in  computer  graphics.  These  principles 
provide  the  necessary  background  information  for  others  who  are  interested  in  the 
research  methodology.  Moreover,  this  chapter  discusses  recent  advances  in  the 
computer  software  and  hardware  technologies  that  support  VR. 

If  a  picture  is  worth  thousands  words,  animated  graphics  are  worth  a  million. 
The  area  of  computer  graphics  started  many  years  ago  after  the  introduction  of 
computers  themselves.  Computer  graphics  began  with  the  display  of  data  on  screens 
and  hardcopy  plotters  [Foley  et  al.  1990].  Sooner  after  that,  when  super  computers  were 
available,  computer  graphics  moved  forward  to  include  the  creation,  storage,  and 
manipulation  of  models  representing  objects.  It  was  not  vmtil  1980s,  when  computer 
workstations  were  becoming  available,  that  the  field  of  computer  graphics  began  to  gain 
more  attention  and  the  usefiilness  of  computer  graphics  in  solving  and  representing 
many  engineering  problems  was  recognized. 

One  of  the  areas  in  which  computer  graphics  was  heavily  involved  was  the  area 
of  Computer  Aided  Drafting  and  Design  (CADD).  Engineers  were  quickly  able  to 
model,  visualize,  and  interactively  manipulate  3-D  models  representing  building 
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components.  Another  area  in  which  computer  graphics  was  utilized  was  simulation  and 
scientific  visualization  [Foley  et  al.  1990].  It  became  obvious  in  the  mid  1980s  that 
computer  graphics  is  the  future  of  communications  among  engineers,  designers, 
planners,  and  managers. 

In  the  late  1980s  computer-generated  graphics  started  to  become  interactive 
(based  on  real-time  calculations)  with  the  advances  in  computer  hardware.  Since  then 
the  area  of  computer  graphics  is  moving  forward  at  a  steep  climb  towards  greater 
improvements  and  the  production  of  more  photo-realistic  images. 

3.2  The  Cartesian  Coordinate  System 

We  live  in  a  consistent,  coordinate  system  with  two  main  references,  local  and 
global.  The  center  of  the  Earth  forms  the  origin  of  our  global  coordinate  system,  and 
any  object  can  be  represented  relative  to  that  origin.  Similarly,  the  center  of  the  object 
represents  the  theoretical  origin  of  its  local  coordinates  relative  to  the  surroimding 
global  envirormient.  Figure  3-1  represents  the  relationship  between  local  and  global 
coordinate  systems. 

The  3-D  coordinate  system  presented  in  Figure  3-1  can  be  also  used  to  represent 
an  object  on  a  2D  computer  screen.  However,  the  z-axis  in  this  case  represents  how  far 
is  the  object  from  the  viewer  position.  A  rectangular  viewing  area  specified  in  world 
coordinates  can  be  mapped  on  the  screen  in  another  rectangular  area  called  a  viewport. 
Figure  3-2  shows  this  mapping  process  which  is  called  viewing  transformation.  By 
changing  the  position  of  the  viewport,  objects  can  be  displayed  at  different  positions  on 
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the  output  device.  Also,  by  varying  the  size  of  the  viewport,  the  size  and  proportions  of 
objects  can  be  changed.  When  different-sized  windows  are  successively  mapped  onto  a 
viewport,  zooming  effects  can  be  achieved  [Foley  et  al.  1990]. 


Figure  3-1 :  Relationship  between  local  and  global  references. 
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Figure  3-2:  2-D  world  and  device  coordinate  mapping. 

Based  on  this  local/global  reference  notation,  a  key  element  in  modeling  an 
object  in  3-D  is  to  indicate  a  child-parent  relationship  between  all  parts  forming  that 
object.  By  doing  that  the  animation  process  can  become  much  easier  and  more  realistic 
[Gordon  et  al.  1990].  When  a  parent  object  moves  or  rotates  during  the  animation 
process,  all  of  its  child  objects  will  have  the  same  translation  and  rotational  values 
applied  to  their  parent  object.  Therefore,  modeling  an  object  in  a  hierarchical  fashion 
establishes  the  relationship  between  each  graphical  primitive  describing  the  model. 

Consider,  for  example,  the  3-D  model  in  Figure  3-3  representing  a  truck.  This 
model  can  be  described  using  a  number  of  sub  models  representing  each  part  of  the 
truck.  Each  part  of  the  truck  has  unique  coordinates,  orientation,  and  rotation  values 
within  the  model.    In  addition,  each  element  has  a  relationship  with  the  adjacent 
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elements  forming  the  truck.  For  example,  the  front  and  rear  tires  are  child  objects  of  the 
base  object  and  the  base  object  itself  is  a  child  object  of  the  overall  truck  and  so  on. 
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Figure  3-3:  Machine  hierarchical  modeling. 


34 

3.3  Object  Representation  in  3-D  Space 

Solid  objects  modeled  in  a  3-D  homogenous  coordinate  system  [x,  y,  z]  can  be 
represented  for  graphics  display  in  number  of  ways.  In  most  cases  they  are  represented 
using  either  polygon  meshes  or  curves.  The  type  of  object  representation  depends  on 
the  method  being  used  by  the  graphics  program  and  the  complexity  of  the  displayed 
object.  For  example,  a  cube  can  be  represented  with  six  plane  faces,  and  a  cylinder  can 
be  displayed  using  a  combination  of  one  curved  surface  and  two  plane  siufaces. 

3.3.1  Polygon  Meshe  Representation: 

The  modeling  technique  that  most  CAD  modeling  packages  use  is  based  on 
polygon  meshes.  A  polygon  mesh  consists  of  edges,  vertices,  and  polygons  as  shown  in 
Figure  3-4. 


Figure  3-4:  Two-polygon-mesh  object  representation. 
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In  Figure  3-4  two  polygons  share  one  edge  (e2)  and  there  are  four  vertices  and 
five  edges  in  this  polygon  mesh.  As  the  number  of  polygons  increases,  the  amount  of 
storage  and  processing  time  by  the  hardware  increases  as  well.  As  a  general  rule-of- 
thumb,  complex  objects  require  more  detailed  polygon  meshes  to  represent  them  in  a  3- 
D  space.  Additionally,  more  processing  power  and  more  computation  time  are  also 
required. 

3.3.2  Curved  Surfaces  Representation: 

Three-dimensional  displays  of  curved  surfaces  can  be  generated  either  from  an 

input  set  of  mathematical  functions  that  define  the  surfaces,  or  a  set  of  user-specified 
data  points.  In  general,  a  3-D  curved  line  can  be  represented  in  an  analytical  form  with 
the  pair  of  functions: 


Coordinate  x  is  selected  as  the  independent  variable.  Values  for  the  dependent  variables 
y  and  z  are  then  determined  from  Equations  (3-1)  and  (3-2)  as  values  for  x  increase 
incrementally  fi-om  line  endpoint  to  the  other  endpoint.  This  type  of  object 
representation  has  a  disadvantage  in  generating  harsh  lines.  Therefore,  parametric 
equations  produce  more  convenient  representation  of  curves  for  graphics  applications. 

By  introducing  a  fourth  parameter,  u,  into  the  coordinate  description  of  a  curve, 
each  of  the  three  Cartesian  coordinates  can  be  expressed  in  parametric  form.  Any  point 
on  the  curve  can  then  be  represented  by  the  vector  function: 


y  =  fix) 


...(3-1) 


...(3-2) 


Piu)  =  ix(u),y(u),z(u)) 


...(3-3) 
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Usually,  the  parametric  equations  are  set  up  so  that  parameter  u  is  defined  in  the  range 
fi-om  0  to  1 .  For  example,  a  circle  in  the  xy  plane  with  center  at  the  coordinate  origin 
could  be  defined  in  parametric  form  as: 

x{u)  =  r.  cos(2;r.w),  y(u)  =  r .  sin(2;r.M),  z(u)  =  0  •  •  •  (3-4) 

A  more  accurate  method  for  constructing  curves  in  3-D  based  on  parametric 
equations  was  discovered  by  the  French  engineer,  Bezier  [Ammeraal,  1992].  Bezier 
discovered  that,  for  any  input  set  of  control  points,  an  approximating  curve  is  formed  by 
adding  a  sequence  of  polynomial  functions  formed  from  the  coordinates  of  the  control 
points.  The  Bezier  coordinate  function  is  calculated  as: 

P(u)  =  t.PkB,,(u)  ...(3-5) 
each  B|y,(u)  is  a  polynomial  function  defined  as: 

B,„{u)  =  C{rt,ky{\-uy-'  ...(3-6) 
The  C(n,k)  represents  the  binomial  coefficients: 

Figure  3-5  represents  examples  of  Bezier  curves  generated  from  three,  four  and 
five  control  points  in  the  xy  plane.  The  dashed  lines  show  the  straight-line  coimection 
of  the  control  points.  With  the  recent  advances  in  the  computer  software  technology, 
most  CAD  programs  use  a  combination  of  polygons  and  curved  surfaces  in  describing 
objects  in  space. 
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3.4  Object  Manipulation  in  3-D  space 


Object  manipulation  in  3-D  homogenous  coordinate  system  refers  to  object 
translation,  rotation,  and  scaling.  As  polygon  meshes  are  the  simplest  representations  of 
3-D  objects,  vertices  are  the  basic  primitives  in  computer  graphics.  Manipulating  an 
object  in  a  3-D  space  include  translation,  rotation,  or  scaling  the  object.  These 
operations  require  a  great  deal  of  matrix  operations  on  the  vertices  representing  the 
object. 


3.4.1  Object  Translation 

In  order  to  translate  a  point  [x,  y,  z]  by  the  amount  [T^,  Ty,  TJ  in  a  3-D 

homogenous  coordinate  system  as  shown  in  Figure  3-6,  the  following  matrix  operation 
is  required: 


\x   y  z 


10  0  0 
0  10  0 
0  0  10 
Tx   Ty   Tz  1 


=  [x'  y   z'  l] 


.(3-8) 


T^,  Ty  and  T^  are  the  parameters  representing  the  distance  of  translation  for  the 
coordinates,  and  [x',  y',  z']  are  coordinates  of  the  new  position.     The  matrix 
representation  of  Equation  (3-8)  is  equivalent  to  the  three  equations: 
x'=x  +  T,  ...(3-9) 
y'=y  +  Ty  ...(3-10) 
z'=z  +  T,  ...(3-11) 
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Similarly  an  object  can  be  translated  in  the  3-D  space  using  Equation  (3-8) 
applied  to  all  points  forming  the  geometry  of  the  object  as  illustrated  in  Figure  3-7. 


Y-Axis 


X-Axis  Z-Axis 


Figure  3-6:  Point  translation  in  3-D  space. 
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Figure  3-7:  Object  translation  in  3-D  space. 
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3.4.2  Object  Scaling 

Scaling  a  point  relative  to  a  3-D  coordinate  system  can  be  expressed  in  a  matrix 
form  as  follows: 


\x   y  z 


Sx:  0  0  0 

0  5:>'  0  0 

0  0  52  0 

0  0  0  1 


=  [;c'   y   z'  l] 


...(3-12) 


In  this  case  S^,  Sy  and  S^are  the  scaling  parameters  for  each  coordinate,  and  [x',  y',  z'] 
are  the  new  scaled  coordinates.  Equation  (3-12)  is  equivalent  to  the  three  equations: 


x'  =  X  *  S, 


y'  =  y  *  Sy 


z'  =  z  *  S, 


...(3-13) 
...(3-14) 


...(3-15) 


Similarly  an  object  can  be  scaled  in  the  3-D  space  using  Equation  (3-12)  applied 
to  all  points  forming  the  geometry  of  the  object  as  illustrated  in  Figure  3-8.  If  the  object 
is  to  be  scaled  relative  to  a  fixed  point  [Xf,  Y{,  Z{]  in  the  space,  the  following  sequence 
of  transformations  must  be  applied:  (1)  translate  the  fixed  point  to  the  origin,  (2)  scale 
the  object  using  Equation  (3-12),  (3)  translate  the  object  back  to  its  original  position. 
Obviously,  this  sequence  of  transformations  should  be  applied  to  each  point 
representing  the  object.  This  sequence  of  transformations  can  be  written  using  the 
matrix  format: 


S,  0  0  0 

0  5^  0  0 

0  0  5,  0 

(\-S^)y,  (\-S,)z,  1 


Y-AxIS 


X-AxU  Z-Axis 

Y-Axit 


X-Axl(  Z-AxIs 
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...(3-16) 


Figure  3-8:  Object  scaling  in  3-D  space. 
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3.4.3  Object  Rotation 

To  specify  a  rotation  for  an  object  in  a  3-D  homogenous  coordinate  system,  the 
axis  of  rotation  must  be  defined.  For  2D  coordinate  system,  the  axis  of  rotation  is 
always  perpendicular  to  the  xy  plane.  However,  in  3-D,  the  axis  of  rotation  can  have 
any  spatial  orientation.  The  easiest  rotation  axes  to  handle  are  those  that  are  parallel  to 
the  coordinate  axes.  The  following  matrix  form  represents  the  rotation  of  a  point  about 
the  z-axis  with  an  amount  0: 

cos^  sin^ 

r  1    -sin^  cos^ 

^   ^   ^1*     0  0 
0  0 

[x'  y  z'  i] 


0 
0 

1 

0 


0 
0 
0 

1 


...(3-17) 


The  rotations  of  a  point  aroimd  the  x-axis  and  the  y-axis  are  given  respectively: 
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Equations  3-1  through  3-19  represent  the  fundamentals  of  3-D  object 
transformations  in  computer  graphics.  Manipulating  an  object  in  space  is  extremely  fast 
once  done  by  the  computer;  however,  the  amount  of  calculation  is  quite  enormous, 
particularly  when  it  comes  to  complex  objects  presented  by  thousands  of  polygon 
meshes,  and  particularly  when  processing  in  real-time.  In  real-time  computer  graphics 
there  are  thousands  of  matrix  operations  required  every  second;  therefore,  it  is  expected 
that  objects  be  represented  using  the  minimum  number  of  polygon  meshes  as  possible. 

3.5  Object  Illumination  in  3-D  Space 

Since  objects  are  modeled  in  3-D  using  polygon  meshes  or  curved  surfaces  as 
their  geometric  representation,  object  illumination  is  another  important  element  to  be 
considered.  There  are  three  main  factors,  which  play  an  important  role  in  how  objects 
are  displayed  on  the  computer  screen.  These  factors  are:  (1)  the  type  and  amount  of 
light  cast  on  the  object;  (2)  the  shading  model;  and  (3)  the  textiire  mapped  to  its 
geometry  [Foley  et  al.  1990].  As  mentioned  earlier,  this  section  is  intended  to 
familiarize  the  reader  with  the  necessary  background  information  required  to  understand 
the  work  done  in  this  study.  Therefore,  a  brief  presentation  is  given  on  the  different 
types  of  light  sources,  the  different  types  of  shading  models,  and  how  texture  mapping 
can  be  used  to  provide  more  realistic  representations  of  3-D  models. 

3.5.1  Types  of  Lighting  Models 

Light  sources  that  illuminate  an  object  are  of  two  basic  types,  light-emitting 
sources  and  light-reflecting  sources.  Light-emitting  sources  are  those  sources  generated 
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using  energy  such  as  light  bulbs  and  the  sun.  Light-reflecting  sources  are  illuminated 
surfaces  of  other  objects,  such  as  the  walls  of  a  room  that  are  near  the  object  viewed.  A 
surface  that  is  not  exposed  directly  to  a  light-emitting  source  will  still  be  visible  if 
nearby  objects  are  illuminated. 

The  multiple  reflections  of  light  from  such  nearby  objects  combine  to  produce  a 
uniform  illumination  called  ambient  light.  Another  type  of  light  is  called  point  source 
light,  which  is  generated  from  a  source  that  is  smaller  compared  to  the  size  of  an  object. 
In  some  cases  a  distributed  light  source  could  be  generated  if  the  light  source  is  larger 
than  the  size  of  an  object. 

A  shading  model  for  calculating  the  intensity  of  light  reflected  from  a  surface 
can  be  established  by  considering  contributions  from  the  ambient  light  sources  and 
point  sources  in  the  vicinity  of  the  surface.  Both  of  these  sources  produce  light 
reflections  that  are  scattered  in  all  directions.  This  scattered  light  is  called  diffuse 
reflection,  and  it  results  from  the  surface's  roughness,  or  graininess.  In  addition  to 
diffuse  reflection,  point  sources  create  highlights,  or  bright  spots,  called  specular 
reflection. 

If  a  surface  is  exposed  only  to  ambient  light,  the  intensity  of  the  diffuse 
reflection  at  any  point  on  the  surface  can  be  expressed  as  follows: 
I  =  Kh  -(3-20) 
The  parameter  I^  is  the  uniform  intensity  of  the  light  and  kj  is  the  coefficient  of 
reflection  for  the  surface.  The  kj  coefficient  is  assigned  a  constant  value  in  the  interval 
0  to  1 ,  according  to  the  reflecting  properties  of  the  surface.  Highly  reflective  surfaces 
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have  a  coefficient  of  reflection  near  1 ;  while  surfaces  that  absorb  most  of  the  incident 
light  have  a  coefficient  of  reflection  near  0. 

The  calculation  of  diffuse  reflection  due  to  a  point  of  light  is  based  on  Lambert's 
cosine  law  [Foley  et  al.  1990],  which  states  that  the  intensity  of  the  reflected  light 
depends  on  the  angle  of  illumination.  A  surface  that  is  perpendicular  to  the  direction  of 
the  incident  light  appears  brighter  than  a  surface  that  is  at  an  angle  to  the  direction  of  the 
incoming  light.  As  the  angle  increases,  less  of  the  incident  Ught  falls  on  the  surface  as 
shown  in  Figure  3-9. 


Figure  3-9:  Diffuse  reflection  of  an  object  exposed  to  light. 

In  Figure  3-9  a  surface  was  modeled  with  a  cone  object  placed  on  top  of  it,  then 
a  light  source  was  applied  perpendicular  to  the  surface.  Notice  that  parts  of  the  cone  are 
not  as  much  illuminated  as  the  surface  points  exposed  directly  to  the  light  source.  This 
is  due  to  the  curved  surface  of  the  cone,  which  is  not  perpendicular  to  the  light  source 
applied  to  it.  The  orientation  of  a  surface  can  be  described  with  a  unit  normal  vector  N 
and  the  direction  to  the  light  source  can  be  expressed  with  a  unit  vector  L.  According  to 
Lambert's  cosine  law,  the  angle  of  incidence  0  is  proportional  to  the  intensity  of  the 
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reflected  light.  Therefore,  cos9  can  be  calculated  from  the  dot  product  of  the  two  unit 
vectors  N  and  L  as  follows: 

cosO=NL  ...(3-21) 

If  cosG  is  a  negative  value,  then  the  light  source  is  behind  the  surface.  The 
brightness  of  an  illuminated  surface  depends  on  the  distance  to  the  light  source. 
Therefore,  if  d  represents  the  distance  from  a  light  source  to  a  point  on  the  surface  and  Ip 
is  the  intensity  of  the  source,  the  intensity  of  the  diffuse  reflection  at  that  position  on  the 
surface  can  be  modeled  as: 

I  =  -~f{N-L)  ...(3-22) 

The  parameter  d^  is  a  constant  that  is  included  in  Equation  (3-22)  to  prevent  the 
dominator  from  approaching  zero.  Equation  (3-22)  is  an  adaptation  of  Lambert's  cosine 
law  that  has  been  found  to  produce  more  realistic  shading  of  surfaces.  Similarly,  if  a 
point  source  is  added  to  the  ambient  light.  Equation  (3-22)  becomes: 

I  =  kJ,+j^{N-L)  ...(3-23) 

At  certain  viewing  angles,  a  shining  surface  reflects  all  incident  light, 
independently  of  the  reflectivity  values.  This  phenomenon  is  called  specular  reflection. 
One  method  of  specular  reflection,  developed  by  Phong  Bui  Tuong  and  called  the 
Phong  model  [Foley  et  al.  1990],  sets  the  intensity  of  specular  reflection  proportional  to 
cos"(|>.  The  value  assigned  to  N  determines  the  type  of  surface  that  is  to  be  viewed.  A 
very  shiny  surface  is  modeled  with  a  large  value  for  n,  and  smaller  values  are  used  for 
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duller  surfaces.  A  perfect  reflector  would  have  n  set  to  infinite.  Since  specular 
reflection  also  depends  on  the  angle  of  incidence,  this  effect  is  also  incorporated  in 
Phong's  model  by  making  the  intensity  proportional  to  a  reflection  function  W(9).  The 
complete  Phongs  model  is  as  follows: 


The  parameter  W(0)  depends  of  the  surface  material. 

3.5.2  Types  of  Shading  Methods 

There  are  a  number  of  methods  that  can  be  applied  to  surface  shading, 
depending  on  the  type  of  the  surface  and  the  requirements  of  a  particular  application. 
An  Object  can  be  described  using  either  a  constant  shading  model  applied  to  all 
polygons  of  the  object,  or  by  using  interpolated  shading  techniques  such  as  Gouraud  and 
Phong  shading  [Foley  et  al.  1990]  which  is  more  time-consuming  and  calculation- 
intensive  process. 

The  most  basic  way  of  shading  methods  is  constant  shading.  For  a  surface 
illuminated  by  a  point  source  of  light,  the  shading  model  produces  a  constant  surface 
intensity,  provided  that  the  point  source  and  the  view  reference  point  are  sufficiently  far 
from  the  surface.  When  the  point  source  is  far  from  the  surface,  there  is  no  change  in 
the  direction  to  the  source,  which  means  N  •  Lis  constant.  Similarly,  the  direction  to  a 
distaint  viewing  point  will  not  change  over  a  surface,  so  V  •  R'ls  also  constant.  However, 
when  the  point  source  and  the  viewing  reference  point  are  close  to  the  surface,  the 


...(3-24) 
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shading  effect  is  harsh  or  unrealistic.  Therefore,  varying  the  intensity  over  each  surface 
according  to  some  interpolation  scheme  would  produce  smoother  shading  effects. 

The  Gouraud  shading  method,  which  introduces  an  intensity  interpolation 
scheme,  removes  discontinuities  between  adjacent  planes  of  a  surface  representation  by 
linearly  varying  the  intensity  over  each  plane  so  that  intensity  values  match  at  the  plane 
boundaries.  In  this  method,  intensity  values  along  each  scan  line  of  the  raster  display 
passing  through  a  surface  are  interpolated  from  the  intensities  at  the  intersection  points 
with  the  surface.  Figure  3-10  demonstrates  this  interpolation  scheme. 


Figure  3-10:  Gouraud  shading  using  intensity  interpolation  scheme. 

For  interpolated  shading,  the  intensity  value  at  point  4  is  determined  from 
intensity  values  at  points  1  and  3.  In  addition,  intensity  at  point  6  is  determined  from 
values  at  points  2  and  3  and  intensities  at  other  points  (such  as  5)  along  the  scan  line  are 
interpolated  between  values  at  points  4  and  6.  In  this  example  the  following  equation 
determines  the  interpolated  intensity  of  point  4: 
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y4  -yi 


y^-y* 


y^-yi 


...(3-25) 


Equation  (3-25)  is  then  repeated  for  each  scan  Une  passing  through  the  polygon 
to  determine  interpolated  intensities  for  any  other  points.  Although  Gouraud  shading 
removes  the  intensity  discontinuities  associated  with  the  constant  shading  model,  it  has 
some  deficiencies.  The  Phong  shading  method  approximates  the  surface  normal  at  each 
point  along  a  scan  line,  then  calculates  the  intensity  using  the  approximated  normal 
vector  at  that  point.  This  method  is  also  known  as  the  Normal-Vector  Interpolation 
Scheme.  However,  the  trade-off  is  that  Phong  shading  requires  considerably  more 
calculations. 

There  are  some  other  shading  methods  such  as  Ray-Tracing  and  Octree  methods 
that  give  more  realistic  results.  However,  all  of  these  methods  are  not  yet  applied  to 
real-time  computer  graphics  since  they  require  very  complex  calculations  even  fast 
computer  workstation  can  not  handle  in  real-time.  Most  of  these  methods  are  used  in 
still-image  applications,  which  are  not  real-time  representations. 

3.5.3  Object  Representation  Using  Textures: 

The  different  shading  models  discussed  earlier  provide  realistic  views  to  some 
extent.  Additionally,  surface  textures  provide  even  more  realistic  representations. 
These  textures  can  be  applied  by  mapping  image  bitmaps  on  the  normal  vectors  coming 
from  surface  polygons  of  an  object.  Mapping  techniques  depend  solely  on  the  geometry 
of  the  object  and  the  way  it  is  being  modeled.  Planar,  cylindrical,  spherical,  or  facet 
texture  mapping  are  all  possible  ways  to  map  a  bitmap  image  on  surfaces  forming  an 
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object.  The  detail  of  the  mapped  bitmap  depends  only  on  the  image  itself,  but  not  the 
object  geometry.  Figure  3-11  illustrates  three  texture-mapping  techniques  flat, 
cylindrical,  and  spherical.  The  mapping  coordinate  system  of  flat,  cylindrical  and 
spherical  projections  are  presented  in  Figure  3-12. 

Depending  on  the  amount  of  available  memory  in  the  hardware,  the  use  of  more 
textures  to  represent  objects,  can  effectively  add  more  realism  to  the  3-D  models.  In 
addition,  textures,  if  used  in  a  smart  v^ay,  can  reduce  significantly  the  number  of 
polygons  describing  an  object.  Thus  allowing  faster  real-time  calculations  and  more 
flexible  real-time  interactions. 
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Figure  3-1 1 :  Different  texture  mapping 


techniques. 
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Figure  3-12:  Different  texture  mapping  coordinate  systems. 


CHAPTER  4 

CONSTRUCTION  SIMULATION  IN  VIRTUAL  ENVIRONMENTS 


4.1  Introduction 

This  study  concentrates  on  presenting  a  methodology  for  construction  simulation 
using  virtual  reality.  Therefore,  it  is  necessary  to  present  the  current  techniques  in 
construction  simulation  based  on  computer  graphics. 

As  mentioned  earlier,  the  concept  of  computer  animation  and  real-time  computer 
graphics  should  not  be  mixed.  Based  on  non  real-time  computer  graphics  and 
animation,  simulation  sequences  could  be  generated  to  describe  a  real  life  process  such 
as  a  construction  operation.  The  time  representation  in  these  simulation  sequences  does 
not  represent  the  actual  time  involved  in  the  process  itself  Consequently,  based  on  real- 
time computer  graphics,  a  process  may  be  simulated  as  if  it  is  happening  in  reality.  The 
time  representation  depends  solely  on  the  performance  of  the  system,  and  the  nimiber  of 
variables  considered  in  modeling  the  process.  Since  VR  shares  the  same  characteristics 
of  the  graphical  simulation  based  on  real-time  calculations,  the  next  section  of  this 
chapter  discusses  the  methodology  of  construction  simulation  based  on  non  real-time 
computer  graphics.  Then  the  technical  mechanics  of  virtual  environments  are  presented. 
Since  the  current  advances  in  VR  evolved  from  many  new  innovative  technologies,  the 
end  of  this  chapter  provides  an  overview  on  these  technologies. 
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4.2  Simulation  Based  on  Non  Real-Time  Computer  Graphics 

Simulation  based  on  non  real-time  computer  graphics  can  be  done  in  many 
ways:  however,  the  general  methodology  is  based  on  developing  a  series  of  computer- 
generated  scenes.  These  scenes  are  created  using  a  large  number  of  high-quality 
computer-generated  images,  which  are  linked  together  in  a  logical  order  as  a  simulation 
file.  This  simulation  file  can  be  then  played  back  any  time.  The  order  in  which  the 
scenes  are  linked  together  should  be  in  a  way  that  best  describes  the  process  under 
simulation. 

Although,  the  main  advantage  of  this  simulation  technique  can  be  realized  in  its 
ability  to  provide  highly  defined  simulations,  but  the  process  is  tedious  and  time 
consuming.  Once  the  simulation  is  done,  there  is  no  way  to  modify  it  or  change  it. 
Another  deficiency  in  this  technique  is  its  inability  to  support  real-time  user-interaction 
[Kangari  et  al.  1991]. 

4.2.1  Wire-frame  modeling  using  CAD 

As  shown  in  Figure  4-1,  the  first  step  in  this  kind  of  graphical  simulation 
requires  CAD  in  order  to  model  the  required  graphical  objects  representing  the  process 
imder  simulation  such  as:  terrain,  equipment,  building  components  and  other  necessary 
elements.  A  wire-frame  model  is  nothing  other  than  a  line-drawing  representation  of 
the  model  in  a  3-D  space  as  illustrated  in  Figure  4-2.  A  rule  of  thumb  is  that  the  higher 
the  complexity  of  the  model,  the  higher  the  number  of  drawn  lines,  and  as  a  result  the 
higher  the  number  of  polygon  meshes,  thus  increasing  the  time  required  in  processing 
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the  model.  Therefore,  shape  optimization  techniques  like  reducing  the  number  of 
polygons,  or  reducing  the  Level  Of  Details  (LOD)  are  essential  tasks.  Recent  advances 
the  computer  software  technology  allows  shape-optimization  techniques  to  be  done  in  a 
much  easier  way  using  computer  programs. 


1  Wire-Frame  Modeling  using 

1              3D  CAD 

n 

Ad  ding /Modifying  the 

required  Graphical 

/i  , 

Attributes  such  as  colors, 

shades,  lights,  textures  etc. 

i 

Adding/Modifying  Motion 

Paths  to  Camera  views  and 

Objects 

i  Rendering  \ 

1    Modifying  the  Animation 

Figure  4-1 :  The  non  real-time  graphical  simulation  technique. 
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Figure  4-2:  A  wire-frame  representation  of  a  model. 

4.2.2  Adding  Realism 

The  next  step  involved  in  developing  a  graphical  simulation  is  an  artistic 
process,  which  may  sometimes  require  an  expert  in  computer  graphics.  Colors,  modes 
of  shading,  light  effects,  and  camera  point  of  views  are  added  to  the  model  in  a  3-D 
space  to  add  the  realism  required  by  the  animation  process.  Depending  on  the  computer 
hardware  and  the  capability  of  the  graphics  program  used,  under  which  these  graphical 
attributes  may  vary  from  system  to  system.  However,  in  most  cases  the  process  is 
similar  among  all  systems.  Moreover,  to  present  the  simulation  in  a  more  realistic  way, 
the  extensive  use  of  textures  is  extremely  powerful  in  providing  strong  representation  of 
the  model. 
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4.2.3  Adding  Animations 

Computer  animation  may  be  done  in  three  formats,  static,  dynamic,  or  a 
combination  of  both.  If  the  position  and  orientation  of  the  camera's  viewpoint  are  fixed 
in  the  3-D  space,  and  one  or  more  of  the  graphical  models  are  changing  their  position  or 
orientation,  it  is  called  a  static  animation.  On  the  other  hand,  a  dynamic  animation 
involves  that  the  camera  viewpoint  changes  its  position  and  orientation  within  the  3-D 
space.  Once  this  process  is  done,  the  computer-generated  models,  lights,  camera  point 
of  views  are  ready  for  the  next  process,  which  is  the  rendering  process. 

4.2.4  The  Rendering  Process 

Rendering  is  the  process  in  which  all  of  the  models,  lights,  colors,  shades,  and 
textures  are  combined  together  and  drawn  on  the  computer  screen.  Depending  on  how 
complex  the  models  are,  their  number,  the  number  of  light  sources,  and  their  types,  the 
time  required  to  perform  this  process  varies  dramatically.  In  addition,  this  time  may 
vary  if  the  user  requires  different  levels  of  rendering  qualities  such  as:  flat-shaded, 
Gourad-shaded,  Phong-shaded  or  ray-traced.  While  flat-shaded  objects  are  rendered 
much  faster  than  ray-traced  objects,  their  quality  in  describing  the  geometry  is  much 
lower.  It  is  a  general-rule-of-thumb  that  the  more  quality  is  required,  which  means 
more  details  to  be  presented,  the  more  time  is  required  for  the  rendering  process. 

4.3  Virtual  Environments  Based  on  Real-Time  Computer  Graphics 

Real-time  computer  graphics  is  another  alternative  for  building  3-D  graphical 
simulations.    In  this  technique  fast  computer  hardware  and  capable  software  are 
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essential  tools.  The  fundamental  difference  between  a  non  real-time  and  a  real-time 
system  is  that  in  real-time  system  the  rendering  process  is  done  at  every  moment  on  the 
computer  screen. 

The  simplest  way  to  imderstand  simulation  using  real-time  computer  graphics  is 
to  imagine  a  closed  loop  system,  in  which  the  system  updates  position,  orientation, 
shades,  and  texture  perspectives  of  all  objects  in  a  3-D  space,  while  the  user  changes  the 
position  and  orientation  of  the  viewing  point.  As  the  user  changes  the  camera  viewpoint 
by  changing  its  location  and  orientation  within  a  3-D  space,  the  hardware  accomplishes 
the  rendering  process  at  every  moment.  In  this  case  the  performance  of  the  rendering 
process  depends  on  the  hardware  speed,  and  the  rendering  package  used.  In  addition, 
user  or  system  events  may  be  taking  place  concurrently. 

The  user  or  the  system  may  generate  events  in  this  closed-loop.  The  3-D  space, 
the  graphical  objects,  the  camera  views,  lights,  and  all  other  attributes  from  a  single 
virtual  environment.  Once  the  system  updates  the  resultant  viewing  positions  and 
orientations,  it  is  ready  to  receive  additional  instructions  from  the  user.  As  a  result,  user 
interaction  with  the  virtual  enviroimient  is  provided  at  all  times  of  the  simulation  cycle. 
Figure  4-3  represents  the  methodology  of  the  VR  technology  based  on  real-time 
computer  graphics. 

4.3.1  What  is  Virtual  Reality? 

Virtual  Reality  is  a  term  used  to  describe  a  user  interaction  with  a  virtual 
envirormient  that  is  simulating  a  process  in  real  life  [Ellis,  1994].  Many  philosophers 
have  argued  that  reality  is  not  a  set  of  physical  objects  that  we  perceive  in  a  certain  way. 
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but  that  reality  is  purely  what  we  perceive  [Griffin,  1992].  Technically,  a  virtual  world 
is  a  3-D  computer-generated  environment  that  is  describing  a  process  taking  place  in  our 
world  or  in  our  state  of  mind.  This  virtual  environment  is  described  by  a  set  of  3-D 
objects.  Each  object  has  a  set  of  rules  and  governing  conditions  describing  its  behavior. 
Similarly,  there  are  rules  to  describe  the  relationship  between  each  object  in  the  virtual 
environment  [Huang,  1994]. 


Figure  4-3:  The  real-time  graphical  simulation  technique. 

Human  interaction  with  the  virtual  environment  is  provided  through  a  set  of 
sensory  devices  allowing  the  user  to  step  inside  this  environment  virtually  [Fisher, 
1991].  This  interaction  between  the  user  and  the  virtual  environment  can  be  described 


Real-Time  Rendering  is  Taking  Place 
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as  a  closed  loop  system  [Fisher,  1991].  In  this  closed  loop  the  human  perceives  the 
virtual  environment,  and  then  alters  it.  This  change  of  state  is  reflected  back  to  the 
human  who  may  alter  it  again  and  the  cycle  continues. 

An  important  aim  of  any  virtiial  envirormient  is  to  give  a  natural  feel  to  the 
illusion  of  being  within  a  virtual  space;  therefore,  visual  and  audio  resolution  should 
match  that  perceivable  by  the  user.  Another  important  aim  in  VR  is  to  minimize 
latency,  the  delay  between  a  cause  of  a  state  change  to  the  virtual  envirormient  and  the 
subsequent  update  and  display  of  the  effect  [Kalawsky,  1990]. 

Since  the  user's  interaction  with  the  computer-generated  virtual  environment  is 
one  key  feature  of  VR,  immersion,  the  degree  to  which  the  user's  senses  interact  with 
the  virtual  environment  and  screened  from  the  real  world  is  also  important.  The  level  of 
immersion  can  vary  significantly  from  one  virtual  environment  to  another  depending 
upon  the  hardware  and  the  available  interface  devices. 

4.3.2  Historical  Background 

Although  virtual  reality  has  recently  become  a  major  media  buzzword,  this 

technology  started  along  time  ago.  Many  researchers  suggest  that  the  flight  simulator, 
which  was  purely  a  mechanical  device,  is  a  predecessor  to  virtual  reality  [Kalawsky, 
1990].  In  the  late  1930s,  a  full-sized  fighter  cockpit  was  constructed  and  mounted  on 
motion  platform  as  one  of  the  first  mechanical  flight  simulators  built  at  that  time 
[Pimentel  et  al.  1995].  In  the  early  1950s,  the  mechanical  flight  simulator  was  ftirther 
improved  with  the  availability  of  commercial  video  cameras.   Video  cameras  were 


61 

mounted  on  movable  platforms  suspended  over  scale  models  of  airports.  Then  the 
camera  motions  control  the  pilot's  view. 

In  1965  Sutherland  published  an  article  entitled  "The  Ultimate  Display",  in 
which  he  described  his  idea  of  the  first  visual-sensing  device,  the  Head  Mount  Display 
or  HMD  [Kalawsky,  1990].  In  1966  Sutherland  developed  the  first  computer-based 
head  mounted  display  at  the  MIT  Lincoln  Laboratory.  In  1972  General  Electric  buih 
the  first  computer-operated  flight  simulator  for  the  navy.  The  Navy  discovered  that 
computer-generated  flying  scenes  are  extremely  helpful  in  training  simulations. 
Through  the  1980s  research  continued  on  the  development  of  virtual  environments  and 
real-time  simulators.  The  University  of  North  Carolina  was  one  of  many  research  areas 
where  virtual  environments  were  explored  in  depth.  In  mid  1980s,  UNC  constructed 
Sitterson  Hall,  a  multi-million  dollar  building  housing  the  Department  of  Computer 
Science  and  a  virtual  reality  research  center.  One  of  the  early  projects  in  UNC  was  the 
development  of  computer-generated  architectural  walk-through  animation  movie  of 
Sitterson  Hall  itself  The  model  of  the  building  was  done  first  in  blue  prints  then  using 
CAD  [Kalawsky,  1990].  Then  the  movement  within  the  3-D  model  was  animated  using 
non  real-time  computer  graphics.  Additionally,  the  project  went  another  step  further 
using  real-time  computer  graphics  and  head  mount  displays  (HMDs)  that  give  the  user 
the  feeling  of  walking  through  the  real  building. 

4.3.3  Elements  of  a  Virtual  Reality  System 

Virtual  reality,  like  any  other  computer-based  technology,  requires  the 
availability  of  many  computer  hardware  and  software  resources  in  order  to  be  applied 
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successfully.  Building  a  virtual  environment  not  only  fast  hardware  (a  workstation, 
graphics  sub-system,  and  output  devices),  but  it  also  requires  a  sophisticated  software 
program  that  is  capable  of  performing  many  sophisticated  graphics  tasks  [Latta,  1994]. 

In  mid  of  the  1980s  the  availability  of  fast  graphics  workstations  was  very 
limited  to  high-end  computer  workstations  such  as  SUN,  HP  and  Silicon  Graphics.  In 
addition,  the  development  of  graphical  user  interfaces  (GUIs)  was  a  tedious,  time 
consuming  and  sometimes  expensive  process.  As  a  result,  VR  was  not  an  affordable 
technology  to  everybody  at  that  time.  With  the  availability  of  today's  advanced 
technologies,  things  are  much  different.  It  is  possible  to  build  a  VR  system  using  the 
PC  platform.  The  availability  of  fast  personal  workstations  has  opened  the  door  for 
many  software-engineering  companies  to  make  VR  a  possible  technology  on  the  PC 
platform. 

Generally,  a  VR  system  consists  of  hardware,  software,  and  peripherals  working 
together  in  real  time.  In  fact,  a  VR  system  is  analogous  to  a  real-time  loop  (refer  to 
Figure  4-4),  in  which  the  user  receives  real-time  feedback  as  output  data  and  sends  real- 
time commands  to  the  system  [Kalawsky,  1990].  If  real-time  processing  is  the  heart  of 
VR,  user  interaction  with  the  generated  virtual  environment  is  the  soul.  Most  of  the 
research  in  VR  is  being  applied  in  finding  ways  to  either  optimize  real-time  processing, 
or  to  enhance  user  interaction.  By  increasing  the  hardware  power,  real-time  calculations 
are  enhanced  to  a  great  extent.  As  a  result,  user  interaction  is  also  enhanced. 
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Figure  4-4:  The  main  elements  in  a  VR  system. 

4.3.3.1  A  virtual  environment 

A  virtxial  environment  can  be  defined  as  a  computer-generated  environment  that 
represents  objects  in  a  3-D  space,  and  the  user  is  able  to  control  both  the  viewing 
conditions  and  the  status  of  the  objects.  In  walk-through  simulations,  for  example,  the 
user  navigates  through  a  3-D  computer-generated  model  of  a  building.  Another 
example  is  fly-by  simulations  that  allow  the  user  to  fly  virtually  around  a  3-D  computer 
generated  scene.  The  interaction  between  the  user  and  the  virtual  environment  takes 
place  when  he/she  change  the  viewing  position,  orientation  or  change  the  status  of  any 
of  the  3-D  objects  within  the  virtual  environment. 
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With  improved  computer  technology  users  are  able  to  place  themselves  within 
these  computer-generated  virtual  environments  using  special  input  devices  such  as 
head-mount-displays,  data-gloves,  and  tracking  devices.  The  user  can  manipulate 
objects  in  a  virtual  environment  using  a  Data  Glove,  a  mouse  or  a  Joystick,  or  he/she 
can  change  his/her  position  and  orientation  within  the  environment  using  a  tracking 
device.  Rotations  and  translations  of  the  computer-generated  scene  correspond  to  the 
user's  rotations  and  translations,  which  gives  the  user  the  illusion  of  immersion,  as  if 
he/she  were  actually  present  within  the  real  environment. 

As  a  general  rule-of-thumb,  complex  virtual  enviroimients  have  more  objects 
and  require  relatively  more  real-time  calculations.  One  important  measure  of  how 
flexibility  and  responsiveness  of  a  virtual  environment  is  by  measuring  the  frame  rate 
during  the  rendering  process,  which  occurs  in  real-time.  Higher  frame  rates  mean  that  a 
higher  number  of  computer-generated  images  are  rendered  in  one  second.  A  frame  rate 
of  30  is  a  common  target  number  for  most  VR  programs  since  the  human  eye  will 
perceive  this  as  a  continuous  motion  sequence. 

4.3.3.2  An  object's  behavior 

One  of  the  most  powerfiil  features  of  simulations  in  virtual  enviroimients  is  the 
ability  to  assign  behavior  for  each  graphical  object  within  the  virtual  environment  based 
on  event-action  paradigm.  For  example,  if  the  user  touches  an  object  within  the  virtual 
environment  using  a  sensory  device,  the  object's  behavior  would  cause  the  object  to 
translate  along  an  axis,  rotate  about  an  axis,  change  its  color,  its  texture,  or  activate 
another  action.     In  most  VR  systems  object  behavior  is  defined  either  using 
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programming  through  a  scripting  language,  or  using  a  graphical  user  interface  (GUI). 
How  flexible  a  VR  system  is  in  assigning  behaviors  for  an  object  depends  solely  on  how 
powerful  the  scripting  language  is.  More  event  and  action  commands  provided  to  the 
user  means  greater  flexibility.  In  addition,  the  easier  the  scripting  language  is;  the  more 
productive  the  VR  system  will  be  and  the  less  time  consumed  in  developing  object 
behavior. 

4.3.3.3  Real-time  hardware 

While  computer  animation  can  be  done  based  on  non  real-time  computer 

graphics,  real-time  computer  graphics  and  user  interaction  are  essential  elements  in  VR 
systems.  In  computer  animation  the  user  combines  a  set  of  high-quality  computer- 
generated  images  together  in  a  logical  fashion.  Once  the  animation  is  finished  he/she 
will  not  be  able  to  change  this  animation  unless  the  complete  rendering  process  is 
repeated.  However,  in  a  VR  system  the  user  interacts  with  a  computer-generated  virtual 
envirorunent  and  the  system  updates  itself  automatically.  While  the  user  changes 
his/her  position  or  interacts  with  the  environment,  the  system  updates  the  new  viewing 
position  and  orientation,  and  then  displays  it  back  to  the  user.  This  process  involves  a 
considerable  amount  of  computing  and  graphics  power  in  order  to  avoid  time  lags 
between  actions  done  by  the  user  and  responses  resulting  from  the  virtual  envirorunent. 

For  a  long  time  high-end  computer  workstations  were  the  only  digital  machines 
capable  of  processing  virtual  environments.  Currently,  virtual  environments  can  be 
modeled  and  built  using  fast  PCs.    The  availability  of  fast  personal  workstations. 
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graphics  accelerators,  advanced  input  and  sensory  devices  makes  it  quite  possible  to 
utilize  the  VR  technology  in  building  virtual  environments. 

4.3.3.4  Real-time  output 

In  recent  years  the  only  possible  way  to  share  data  between  the  user  and  the 

computer  was  purely  in  a  text-oriented  format.  Now,  data  can  be  represented  in  many 
visual  forms.  In  a  VR  system  output  on  the  screen  may  result  from  a  user  interaction 
with  the  virtual  environment  such  as  changing  his/her  position  or  orientation  within  the 
virtual  environment.  In  addition,  an  output  may  be  an  action  such  as  a  visual  or  an 
audio  effect,  taking  place  within  the  virtual  environment  if  a  certain  event  occurred. 
The  user  feeds  the  real-time  system  with  data  in  either  visual  or  text-oriented  formats, 
then  he/she  receives  visual  effects  taking  place  in  the  virtual  environment. 

4.3.3.5  Real-time  user  interaction 

The  user  plays  an  important  role  in  controlling  the  global  behavior  of  a  virtual 
environment.  Current  advances  in  computer  hardware  technologies  give  the  user  the 
ability  to  step  into  the  virtual  environment  thus  allowing  him/her  full  or  partial 
immersion.  Immersion  is  the  ultimate  goal  of  VR  systems  since  it  provides  the  illusion 
of  real  experience.  Many  researchers  define  VR  as  the  tool  for  enabling  the  user's 
immersion  into  a  sensory-rich,  interactive  experience  [Pimentel  et  al.  1995].  Using 
input  and  output  sensors,  a  participant  can  fabricate  and  control  a  virtual  world.  Current 
VR  systems  simulate  a  real  process  in  a  360-degree  virtual  environment  and  the  user 
immerses  himselfiTierself  in  that  virtual  envirorunent  and  interacts  with  objects  in  the 
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environment  using  sensory  devices  such  as  HMDs,  data  gloves  or  navigation  controls 
[Pimentel  et  al.  1995]. 

4.3.3.6  Input  instructions 

In  VR  systems  input  commands  are  those  given  by  the  user  or  resulting  from  an 

event  that  took  place  in  the  virtual  environment.  The  user  may  instruct  the  virtual 
enviroimient  to  change  or  alter  its  behavior,  or  he/she  may  instruct  an  object  within  the 
virtual  environment  to  perform  a  certain  action.  Depending  on  how  advanced  the  VR 
system  is  and  how  complex  the  generated  virtual  envirormient  is,  many  commands  may 
be  given  to  the  system  to  achieve  accomplish  tasks. 

With  the  availability  of  advanced  GUIs  like  those  in  Windows  95  and  Windows 
NT,  input  commands  may  be  in  a  text-oriented  format  given  by  the  user  through  a 
number  of  GUIs  elements  such  as  dialog  boxes,  input  boxes,  or  from  a  data  base.  One 
goal  of  a  VR  system  is  to  simulate  a  process  in  a  3-D  visual  format;  therefore,  advanced 
VR  systems  provide  an  immersive  way  to  feed  the  system  with  instruction  given  by  the 
user.  One  example  of  such  a  case  is  the  immersive  tool  box,  which  allows  the  user  to 
select  a  certain  behavior,  assign  it  to  a  certain  object,  or  change  the  attributes  of  the 
virtual  environment  (the  colors,  shades,  lights,  camera  views  or  textures). 

In  many  VR  systems  the  user  gives  commands  to  the  virtual  environment 
through  a  scripting  language.  This  scripting  language  could  be  a  complex  low-level 
language  such  as  C  or  C++,  or  a  much  easier  higher  level  language  like  BASIC. 
Similarly,  many  VR  systems  have  their  own  English-based  scripting  langiiages. 
Commands  given  by  the  user  to  the  virtual  environment  should  follow  an  event-action 
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paradigm;  as  a  result,  complex  tasks  require  more  commands.  Currently,  it  is  possible 

to  combine  an  object-oriented  programming  language  like  Visual  Basic^  with  VR 
systems.  As  a  result,  more  control  and  flexibility  are  given  to  the  user  to  describe  more 
complex  tasks. 

4.3.3.7  Sensory  devices 

In  a  virtual  environment  the  only  way  to  have  the  user  immersed  in  the 

computer-generated  world  is  by  means  of  sensory  devices  like  HMDs,  data  gloves, 
motion  trackers,  thermal  sensors,  or  other  types  of  sensors.  Head  Mounted  Displays 
(HMDs)  and  motion  tracking  devices  are  used  to  map  the  user's  translations  and 
rotations  to  the  viewing  translations  and  rotations  on  the  display.  Figure  4-5  and  4-6 
presents  a  HMD  and  a  tracking  device  respectively.  Data-gloves  are  another  type  of 
sensory  device  by  which  the  user  can  select,  and  manipulate  objects  within  the  virtual 
environment.  When  the  user  points  to  an  object  in  the  virtual  space,  the  tracking  device 
maps  his/her  hand  coordinates  to  the  object  selected.  Then  this  object  is  either 
translated  or  rotated  in  the  virtual  environment  coordinate  system.  Figure  4-7  represents 
a  data  glove  device.  There  are  some  other  sensory  devices  that  can  be  used  in  either 
object  selection,  or  manipulation:  2D  mices,  3-D  mices,  navigation  joysticks,  or  space 
balls  as  shown  in  figures  4-8.  '  * 
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Figure  4-5:  A  head  mount  display  (HMD)  device  [Pimentel  et  al.  1995]. 


Figure  4-6:  A  motion  tracking  device  [Pimentel  et  al.  1995]. 


Figure  4-7:  A  data  glove  sensory  device  [Pimentel  et  al.  1995]. 
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Figure  4-9:  A  3-D  navigation  joystick  device  [Pimentel  et  al.  1995]. 
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Figure  4-10:  A  3-D  mouse  [Pimentel  et  al.  1995]. 


74 

4.4  Current  Technologies  in  Support  to  Virtual  Environments 

With  the  overwhelming  number  of  new  advanced  technologies  in  the  computer 
hardware  and  software  industries,  VR  is  taking  a  great  step  towards  being  an  effective 
and  inexpensive  modeling  and  simulation  tool  in  solving  many  engineering  problems. 
In  the  early  1990s  several  computer  companies  such  as  Division  Incorporated,  SenseS 
Corporation,  and  VREAM  Incorporated  started  to  take  the  lead  in  developing  VR 
systems,  and  custom  VR  applications.  Most  of  the  research  funded  these  companies 
was  primarily  from  NASA  and  the  department  of  Defense.  The  main  objective  of  these 
companies  is  to  apply  the  technology  in  developing  virtual  environments  for  training 
and  simulation  applications.  The  success  of  these  companies  suggests  that  developing 
virtual  environments  for  training  simulations  will  be  a  strong  problem-solving  tool  in 
the  near  future  to  many  engineering  fields. 

4.4.1  Virtual  Environments  Authoring  Programs 

A  few  years  ago  these  companies,  and  many  others  in  the  United  States,  started 
to  put  their  experience  into  developing  user-level  VR  systems  (called  authoring 
programs).  Their  main  objective  was  to  expose  the  PC  user  to  the  VR  technology. 
Most  of  these  packages  allow  the  user  to  develop  VR  applications  in  an  easy,  less  time- 
consuming,  and  inexpensive  way. 

Packages  used  to  develop  object-oriented  virtual  environments  share  many 
common  features.  One  feature  is  that  they  are  based  on  real-tune  interactive  computer 
graphics.  This  means  that  the  user  navigates  through  a  3-D  virtual  environment  and 


75 

interacts  with  objects  within  that  virtual  environment  in  real-time,  as  the  rendering 
process  takes  place.  During  this  real-time  user-environment  interaction,  objects  are 
following  a  behavior  pre-assigned  by  the  user.  Another  feature  in  these  programs  is  the 
scripting  languages  they  provide.  Some  of  these  programs  have  their  own  English- 
based  scripting  languages,  which  support  many  functions  such  as  object  manipulation, 
and  changing  environment  attributes  (colors,  shades,  and  lights).  Other  programs  are 

using  high-level  programming  languages  like  Visual  Basic,  and  Java^. 

In  addition  to  the  real-time  processing,  and  the  support  for  interface  languages,  a 
common  feature  in  all  of  the  VR  authoring  programs  is  their  support  to  many  sensory 
devices.  In  order  to  take  advantage  of  the  advanced  operating  systems,  most  of  the  VR 
authoring  tools,  available  in  today's  market,  were  designed  to  operate  on  graphical  user 
operating  systems  like  Window  95  or  Windows  NT,  thus  allowing  the  user  to  become 
more  easily  familiar  ynth  their  tools.  Since  the  study  conducted  in  this  research 
involved  the  author's  ovm  experience  in  one  of  these  systems,  the  next  chapter  will 
discuss  in  more  details,  the  WorldUp  development  enviromnent  as  an  example  to  these 
packages. 

Additionally,  most  of  the  available  VR  authoring  programs  have  their  own  CAD 
modeling  tools  built  within  their  GUIs,  which  provides  the  user  greater  flexibility. 
Moreover,  the  majority  of  these  programs  facilitate  the  possibility  of  importing  3-D 
CAD  models,  created  in  other  modeling  programs,  which  enhance  the  portability  of 
CAD  models. 
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4.4.2  Portability 

In  the  past,  super  computers  and  computer  mainframes  were  used  to  aid  in 
solving  many  of  the  engineering  problems  in  areas  such  as  design  and  manufacturing. 
Since  the  1980s  most  of  the  engineering  problems  that  required  digital  computations  are 
analyzed  using  powerful  workstations  manufactured  by  SUN,  HP,  and  Silicon  Graphics. 
The  main  features  of  these  powerful  workstations  are  speed,  and  advanced  graphics- 
display  capabilities. 

Basically,  a  workstation  is  a  fast  computer  machine  with  advanced  and  capable 
graphics-display  hardware.  Today,  personal  workstations  replace  these  workstations. 
One  of  the  greatest  advances  in  today's  technology  is  the  availability  of  fast  personal 
workstations  on  the  PC  platform.  Personal  computer  workstations  based  on  Intel's 
Pentium^  and  Pentium  Pro  machines  are  giving  the  user  great  flexibility  in  solving 
engineering  problems  at  high  speeds,  high  raster  definitions,  and  with  a  fraction  of  the 
cost  involved  in  old  workstations.  Additionally,  the  advanced  technologies  in  computer 
software  engineering  make  it  possible  to  write  one  code  that  is  compatible  with  many 
platforms. 

As  a  result  of  the  advances  in  software  and  hardware  computer  technologies, 
migration  towards  the  PC  platform  started  to  take  place  a  few  years  ago.  This  migration 
led  many  of  the  computer  software  companies  to  make  their  applications  portable  across 
many  computer  platforms.  Such  migration  assures  portability  to  the  user,  and  keeps  the 
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door  open  to  choose  which  platform  is  more  cost  effective.  One  area,  which  took 
advantage  of  computer  portabiUty,  was  the  area  of  computer  graphics. 

4.4.3  Portable  Rendering  Engines 

The  simplest  definition  of  a  rendering  engine  is  a  code  that  draws  2D  or  3-D 

objects  on  the  screen  vnth  colors,  shades,  and  textures.  Since  this  code  is  a  machine- 
independent  instruction,  this  code  remains  the  same  on  two  different  platforms.  The 
only  difference  between  two  different  versions  of  the  same  code  is  the  format  used  to 
write  the  code  for  each  platform.  It  is  common  to  write  a  single  code  that  is  capable  of 
identifying  on  which  platform  it  is  running.  This  single  code  is  what  is  knovra  as  an 
Application  Programmers  Interface  (API). 

One  of  the  most  advanced  APIs  in  computer  graphics  and  animation  is  the 
OpenGL  API.  The  OpenGL  API  was  originally  developed  by  Silicon  Graphics.  About 
two  years  ago  Microsoft  Corporation  acquired  OpenGL  and  supported  that  API  on  its 
operating  system  Windows  NT.  The  most  powerful  two  features  of  the  OpenGL  API  is 
the  quality  of  the  generated  images,  and  its  support  by  many  operating  systems  and 
graphics  accelerator  boards.  This  means  that  the  raster  display  board  rather  than  the 
main  processor  accomplishes  the  necessary  rendering  calculations.  As  a  result,  the  main 
processor  remains  free  for  other  calculations,  which  greatly  increases  the  performance 
of  the  application. 
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4.4.4  The  Virtual  Reality  Modeling  Language  (VRML) 

The  most  important  advancement  in  computer  networking  is  the  Information 
Super  Highway  or  the  Internet.  During  the  1960s,  the  United  States  Department  of 
Defense  saw  a  need  to  maintain  some  kind  of  communications  network  in  the  event  of  a 
nuclear  attack.  The  RAND  Corporation,  a  U.S.  military  think-tank,  proposed  a 
decentralized  communications  network  as  a  solution.  In  1984  the  National  Science 
Foundation  began  to  provide  funding  for  the  establishment  of  research  and  academic 
networks  through  the  U.S.  In  1986,  it  linked  those  networks  into  a  high  speed  network 
using  the  TCP/IP  protocols  developed  at  the  University  of  California  in  Los  Angeles 
(UCLA)  [Matsuba  et  al.  1996]. 

Although  the  Internet  was  growing  during  the  1980s  and  early  1990s, 
commercial  applications  were  restricted  by  the  NSF  Acceptable  Use  Policy  (AUP).  In 
April  1994  the  Internet  became  the  largest  commercial  computer  network  in  history. 
Furthermore,  the  World  Wide  Web  (WWW),  which  is  a  system  for  creating  and 
browsing  hypertexts  on  the  Internet,  began  in  1989  as  an  initiative  from  the  European 
Laboratory  for  Particle  Physics  (CERN).  A  proposal  was  made  with  a  set  of  protocols 
for  an  information  distribution  system  on  the  Internet  to  be  used  among  research  groups 
exploring  high-energy  physics.  These  protocols  were  eventually  adopted  by  other 
organizations.  In  1993,  the  National  Center  for  Supercomputing  Applications  (NCSA) 
released  a  Web  browser  for  the  UNIX,  Windows,  and  Macintosh  platforms.  This 
browser,  called  Mosaic,  opened  the  Web  to  a  wider  audience  and  was  the  catalyst  that 
helped  the  phenomenal  growth  of  the  Internet  [Matsuba  et  al.  1996]. 
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In  1994,  Mark  Pesce  and  Tony  Parisi  realized  the  effectiveness  and  the 
usefulness  of  using  the  Internet  in  Virtual  Reality.  Therefore,  they  developed  a 
program,  called  Labyrinth,  which  was  able  to  retrieve  3-D  objects  over  the  Web,  using 
the  same  protocols  that  the  Internet  uses.  The  API  rendering  engine  used  to  develop 
Labyrinth  was  RealityLab,  which  was  developed  by  a  British  company  called 
RenderMorphics.  The  main  feature  of  RealityLab  was  its  rendering  speed  that  does  not 
require  hardware  acceleration.  In  May  1994,  Labyrinth  was  presented  at  the  First 
International  Conference  on  the  World  Wide  Web  in  Geneva,  Switzerland,  and  the 
Virtual  Reality  Modeling  Language  (VRML)  was  bom  [Matsuba  et  al.  1996]. 

The  importance  of  VRML  lies  in  the  ability  to  develop  3-D  computer-generated 
virtual  environments  on  the  World  Wide  Web.  The  current  specifications  of  VRML 
(version  2.0)  let  the  user  experience  virtual  envirorunents  with  a  fully  immersive  mode, 
and  facilitate  the  creation  of  multi-user  virtual  environments.  As  a  result,  VR  can  be 
effectively  utilized  over  the  Internet  in  training  applications.  In  addition,  VRML  will 
make  it  much  easier  to  use  VR  as  a  selling  tool  for  many  projects  where  the  different 
parties  involved  are  not  within  the  same  location. 
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CHAPTER  5 
RESEARCH  EXPIREMENTAL  TOOLS 

5.1  Introduction 

The  first  stage  in  developing  the  research  methodology  was  concentrated  on  | 
investigating  three  pre-release  (Beta)  versions  of  newly  developed  VR  authoring 
programs:  VRCreator  by  VREAM  Inc.,  dVISE  from  DIVISION  Inc.,  and  WorldUp 
from  Senses  Corporation.  This  stage  was  the  most  time  consuming  and  the  most  work-  ' 
intensive  stage  since  it  required  the  author's  familiarization  with  three  different 
packages.  Figure  5-1,  illustrates  a  Time-Line  chart  representing  the  time  taken  by  the 
author  to  evaluate  three  visual-simulations  authoring  programs,  for  this  research, 
VRCreator,  WorldUp,  and  dVISE. 


Prior  to  1995 

From  Jan.  1996  To  May  1996 

From  May  1996  To  Nov.  1996 

VRCreator  evaluation 

WoildUp  evaluation 
dVISE  evaluation 

September  1996 


Figure  5-1 :  A  time  line  chart  of  periods  involved  in  evaluating  the  VR  systems. 
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5.2  Investigation 

As  mentioned  earlier,  one  of  the  most  advances  in  software  engineering  that  will 
benefit  many  of  today's  engineering  application  is  the  availability  of  software  tools  that 
facilitates  the  creation  of  visual  simulations.  Most  of  these  packages  are  either  in  their 
early  stages,  or  still  under  development.  In  1990s,  companies  like  VREAM 
Incorporated,  SenseS  Corporation,  DIVISION  Incorporated,  and  many  others  started  to 
target  their  packages  towards  the  PC  platform,  which  resulted  in  the  development  of 
many  VR  prototyping  tools  like  the  three  investigated  in  this  research.  These  three 
programs  were  chosen  based  on  their  features  among  other  programs  available  on  the 
PC  market  place. 

5.2.1  The  VRCreator  Program 

Since  the  author  started  working  with  the  DOS  version  of  VRCreator  in  1994,  he 
decided  to  start  with  that  program.  In  1995  VREAM  released  the  first  pre-release 
(Alpha)  version  on  Windows  3.1  and  Windows  95  respectively.  The  author  was  chosen 
by  the  VRCreator  development  team  to  evaluate  this  version.  Although  the  scripting 
language  in  the  Alpha  version  was  based  on  the  same  DOS-version  scripting  language, 
several  problems  prevented  the  VRCreator  to  be  fiiUy  released.  The  first  problem  was 

caused  by  the  rendering  engine,  based  on  RealityLab  API  (lately  called  Direct3-D^), 
that  was  delayed  by  Microsoft.  The  second  problem  is  due  to  that  most  of  these 
programs  were  built  to  support  VRML,  and  the  VRML  specifications  (VRML  1 .0)  were 


DirectSD  is  a  registered  trademark  of  Microsoft  Corp. 
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still  under  developments  at  that  time.  The  third  problem  was  some  programming 
difficulties  faced  the  development  team  in  VREAM.  These  problems  made  it  apparent 
that  another  development  tool  must  be  used. 

5.2.2  The  WorldUp  Program 

Senses  Corporation  chose  the  Windows  NT  operating  system  for  the  WorldUp 

program,  because  NT  supports  the  OpenGL  API  rendering  engine.  In  January  1996, 
Senses  released  the  first  commercial  version  of  WorldUp  nmning  on  the  Windows  NT 
(NT  Version  3.51)  operating  system  [WorldUp,  1996].  The  company  decided  to  release 
two  versions  every  year  of  WorldUp  even  if  the  program  was  not  yet  completed,  so  that 
developers  who  use  WorldUp  could  give  their  input  and  suggestions  for  enhancing  the 
WorldUp  development  environment  and  its  simulation  features.  Six  months  later. 
Senses  released  the  second  version  of  WorldUp,  the  May  1996  Release,  solving  many 
problems  in  the  program,  by  enhancing  its  scripting-language  compiler,  and  its  GUI, 
and  by  adding  Windows  95  computability,  and  an  integrated  modeler  to  the  program. 
Although  many  bugs  and  problems  were  fixed  in  this  release,  WorldUp  still  had  the 
tendency  to  crash.  Therefore,  the  company  started  working  on  the  1997  January  release. 
In  November  1996,  the  author  was  chosen  by  the  WorldUp  development  team  to 
evaluate  a  prerelease  (Beta),  a  much-more  stable  version  of  WorldUp,  that  to  be 
released  in  January  1997.  It  was  apparent  that  WorldUp  would  be  the  most  convenient 
tool  that  can  be  used  to  develop  SIMCON  (refer  to  Appendix  C). 
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5.2.3  The  dVISE  Program 

In  September  1996,  the  author  decided  to  evaluate  a  newly  developed  VR 
authoring  program  called  dVISE  by  DIVISION  Incorporated.  This  program,  based  on 
the  OpenGL  and  RealityLab  software-rendering  engines,  was  developed  on  the 
Windows  NT  operating  system  based  on  a  successfijl  UNIX  version.  The  program 
lacked  two  important  features,  an  integrated  modeler,  and  an  easy-to-use  GUI.  Many  of 
the  functions  in  the  dVISE  program  have  to  be  done  through  a  DOS-based  patch  files 
and  commands.  Therefore,  this  program  was  not  suitable,  and  was  excluded  fi'om  being 
used  in  this  study  (to  develop  SIMCON). 

5.3  A  Brief  History  on  WorldUp 

Senses  Corporation  is  a  company  founded  in  1990  with  an  objective  of  bringing 
the  VR  technology  from  research  to  commercial  use.  The  company  started  its  interest 
in  developing  VR  applications  on  the  PC  platform.  The  company  started  to  release  its 
experience  as  a  software  development  library,  based  on  the  C  programming  language, 
named  WorldToolKit.  This  library  facilitates  the  creation  of  virtual  worlds  by  the  C 
programming  language.  In  January  1996,  SenseS  shipped  the  first  version  of  the 
WorldUp  program,  which  was  built  on  top  of  WorldToolKit  giving  the  user  more 
flexible  and  easy-to-use  development  environment. 

5.4  Features  of  WorldUp 

The  GUI  of  WorldUp,  shown  in  Figure  5-2,  is  divided  into  four  major  sections  to  help 
the  developer  create  visual  simulations  easily  and  intuitively.   Based  on  an  object- 


oriented  framework,  there  are  14  object  classes  available  in  the  program.  The  Type 
Browser  section  in  WorldUp  contains  a  tree  representation  of  these  classes  where  the 
user  can  create  objects  based  on  these  object  classes.  The  Property  Browser  section 
allows  the  developer  to  modify,  or  change  any  of  the  objects'  properties  available  at  the 
design  time.  The  simulation  window  is  where  the  developer  can  preview  his/her 
simulation  before  it  is  compiled.  The  Status  window  in  the  WorldUp  development 
environment  is  where  the  compiler  returns  any  error  messages  to  the  user  after 
compiling  the  script  modules,  which  might  be  added  to  the  simulation.  The  Scene 
Graph  Browser  section  is  included  to  show  the  developer  the  hierarchical  relationship 
between  the  different  objects  within  the  simulation  [WorldUp,  1996]. 

Since  the  scripting  language  in  WoridUp  is  primarily  considered  as  a  high-level 
programming  language,  GUIs  can  be  developed  and  linked  to  the  generated  virtual 
environments  through  WorldUp.   Once  the  application  is  developed,  it  can  then  be 

played  by  another  program  called  WorldUp  Player^.  The  main  fimction  of  WorldUp 
Player  is  to  browse  the  application  without  the  WorldUp  development  environment. 
There  are  two  different  Players  that  can  be  freely  distributed  to  the  end-user.  The  first 
one  is  an  add-in  Internet  browser  that  can  be  added  to  Internet  browsers  such  as 
Netscape^  or  Microsoft  Explorer  And  the  other  one  is  a  stand-alone  player,  which 
can  be  shipped  to  the  end-user  freely  with  the  application. 


^  WorldUp  Player  is  a  registered  trademark  of  SenseS  Corporation. 

9  Netscape  is  a  registered  trademark  of  Netscape  Corporation. 

1^  Internet  Explorer  is  a  registered  trademark  of  Microsoft  Corporation. 
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Figure  5-2:  The  WorldUp  development  environment. 

The  WorldUp  program  has  many  features  built  into  it.  The  most  recognizable 
feature  in  WorldUp  is  the  object-oriented  application  framework.  The  developer  builds 
objects  (such  as  geometry,  a  sensory  device,  a  window  etc.)  which  are  then  used  during 
the  simulation.  Each  of  these  objects  has  a  set  of  properties,  which  can  be  changed 
using  the  scripting  language  by  developers. 

Another  powerful  feature,  found  in  WorldUp,  is  its  use  of  the  OpenGL  software- 
rendering  engine.  Many  hardware  graphics-accelerator  boards  available  in  the  market 
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support  this  software-rendering  engine.  One  another  important  feature  in  WorldUp  is 
its  cross-platform  portability  among  many  computer  platforms.  Cross  platform 
portability  means  that  an  application  developed  on  the  UNIX  version  of  WorldUp  can 
be  viewed  on  its  Windows  NT  version  without  recompilation;  thus,  allowing  the  user  to 
decide  which  platform  is  more  cost  effective  to  the  job.  Additionally,  an  integrated 
modeling  tool  built  in  WorldUp  called  WorldUp  Player  allows  the  developer  to  create 
new  3-D  models  that  can  be  used  in  the  simulation,  or  edit  an  existing  3-D  model.  This 
tool  gives  developers  the  ability  to  Import  3-D  models  created  in  other  CAD  programs 
such  as  AutoCAD,  3-D  Studio,  or  even  written  in  VRML.  In  addition,  colors,  materials, 
or  textures  can  be  added  to  the  3-D  models  using  the  WorldUp  Modeler  program. 

5.5  WorldUp  Basics 

This  section  presents  some  of  the  basic  operations  that  developers  must  go 
through  when  building  a  virtual  environment. 

5.5.1  Object  Types  in  WorldUp 

WorldUp  was  developed  using  C++,  an  object-oriented  programming  language. 
There  are  14  base  classes  that  have  been  used  to  develop  WorldUp  based  on  the 
WorldToolKit  API  for  Windows.  The  most  important  object  type  is  the  Geometry  type 
by  which  the  developer  can  build  3-D  models,  or  import  from  other  CAD  programs. 
The  following  is  a  list  of  some  other  object  types  in  WorldUp: 

•  Sensory  objects  (such  as  serial  joysticks,  3-D  mice,  space  balls,  HMDs  etc.) 

•  Group  objects  for  assembling  complex  models 
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•  Light  objects  (such  as  point,  directional,  and  ambient) 

•  Window  objects  which  act  as  containers  to  viewport  objects 

•  Script  objects  to  define  an  object  behavior  using  the  scripting  language 

•  DataBase  objects  for  building  simulations  from  a  database 

Once  the  user  starts  the  simulation  cycle,  each  object  type  used  during  the  development 
phase  has  a  certain  fiinction  during  the  simulation.  For  example,  a  window  object  will 
appear  on  the  display  screen  presenting  the  simulation  to  the  user.  In  addition,  the  user 
might  have  the  option  to  be  frilly  immersed  within  the  simulation  using  sensory  objects 
depending  on  how  the  application  was  developed.  Figure  5-3  presents  the  different 
object  types  supported  in  the  WorldUp  development  environment. 

Since  WorldUp  was  developed  taking  into  consideration  the  object-oriented 
programming  (OOP)  structure,  one  of  the  most  recognizable  features  in  the  program  is 
the  dynamic  property  inheritance.  The  developer  defines  a  sub  type  to  one  of  the  object 
types,  and  all  of  the  properties  of  that  type  are  inherited  in  it.  As  a  result,  the  developer 
has  great  flexibility  to  develop  an  application. 

5.5.2  Object  Properties 

In  the  WorldUp  development  environment,  there  are  a  number  of  properties 
related  to  each  type  of  objects  by  which  the  developer  can  control  the  appearance  and 
the  behavior  of  the  simulation.  Developers,  through  the  Property  Browser  section  in  the 
WorldUp  GUI  (shown  in  Figure  5-4),  can  control  these  properties.  They  are  fiiUy 
exposed  to  the  developer  when  he/she  is  developing  the  application.  However,  the  user 
has  a  controlled  access  to  these  properties  depending  on  how  much  the  developer  has 
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given  him/her  through  the  scripting  code.  In  other  words,  it  depends  on  how  the 
application  was  developed,  and  what  properties  are  exposed  to  the  user  when  the 
simulation  is  running.  This  development  structure  is  identical  to  the  Visual  Basic 
development  structure. 


Figure  5-3:  Types  of  objects  in  WorldUp. 
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Figure  5-4:  The  WorldUp  Property  Browser. 
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5.5.3  Organization  of  Graphical  Objects  Within  the  Virtual  Environment 

When  developing  a  virtual  environment,  objects  are  organized  according  to  their 

functions  and  hierarchical  relationships.  Using  the  Scene  Graph  Browser  in  WorldUp, 
objects  are  grouped  together  to  assemble  another  object.  For  example,  the  hierarchical 
representation  of  a  virtual  environment  (like  the  one  described  in  Figure  5-5)  can  be 
represented  in  the  Scene  Graph  Browser  (as  shown  in  Figure  5-6).  The  terrain  3-D 
model  in  this  case  is  the  parent  object  to  all  other  objects  within  the  simulation. 
Similarly,  the  moving  machine  will  be  divided  in  a  hierarchical  fashion  describing  the 
parent-child  relationships  between  its  parts. 

The  object-oriented  description  gives  the  user  the  ability  to  control  every  part  of 
the  machine.  Generally,  grouping  the  objects  in  the  virtual  environment  within  the 
hierarchical  tree  representation  should  be  in  such  a  way  that  organizes  all  objects  with 
similar  behavior  together.  Figure  31  represents  how  this  virtual  environment  might 
appear  during  the  simulation  cycle. 

5.5.4  Scripting  in  WorldUp 

One  of  the  most  intuitive  features  added  to  the  WorldUp  development 
environment  is  the  Basic  Script  programming  language.  This  programming  language, 
which  is  identical  to  Visual  Basic,  is  used  mainly  to  assign  behavior  to  the  different 
objects  appear,  within  the  simulation.  In  addition,  the  user  can  control  the  appearance 
of  the  developed  application  with  this  structured  programming  language.  The  language 
facilitates  the  ability  to  add  GUI  controls  such  as  dialog  boxes,  list  boxes,  buttons,  etc. 
Moreover,  it  gives  the  user  the  ability  to  link  C  or  C++  codes  to  the  developed  modules, 
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which  means  more  flexibility  in  designing  large  applications.  Once  the  developer  has 
written  and  compiled  the  script  modules  of  the  application,  the  internal  engines  within 
WorldUp  Player  can  then  play  this  application  without  the  need  for  the  development 
environment.  If  the  developer  wants  the  user  to  have  the  ability  to  modify  the 
application,  he/she  must  write  the  scripting  modules  to  do  so.  Figure  5-7  illustrates  how 
an  application  developed  using  WorldUp,  interpreted  by  the  internal  engines  in 
WorldUp  Player. 


Figure  5-5:  A  virtual  environment  showing  a  machine  on  a  terrain 
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Figure  5-6:  The  WorldUp  Scene  Graph  Browser. 
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Figure  5-7:  The  structure  of  a  WorldUp  application. 

Script  modules  in  WorldUp  have  the  same  structure  as  modules  written  using 
Microsoft  Visual  Basic.  Subroutines,  routine  loops  (IF... THEN... ELSE),  select  cases 
(SELECT  CASE... END  SELECT),  and  other  programming  statements  in  Visual  Basic 
can  be  used  in  the  Basic  Script  programming  language  in  WorldUp  by  the  developer. 
Hence,  the  developer  has  extreme  flexibility  in  designing  the  application  for  the  end 
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user.  At  development  time,  the  developer  controls  the  behavior  of  graphical  objects, 

sensory  devices,  or  other  GUI  elements,  forming  the  simulation  application,  by  dynamic 

referencing.  For  example,  when  the  developer  wants  to  write  a  programming  statement 

to  perform  a  certain  operation  on  an  object,  he/she  must  first  tell  the  application  which 

object  is  meant  by  the  operation,  then  he  can  attach  the  code  required  to  perform  the 

operation  on  that  object  as  follows: 

Dim  My  Object  As  Geometry 

Set  MyObject  =  GetGeometry  (Vehicle) 

MyObject-Translate  10,0,0 

In  the  above  code  the  WorldUp  Player  internal  engines  perform  three  operations.  First, 
it  will  assign  a  new  variable,  called  'MyObject',  as  a  'Geometry'  type.  Then,  it  will  link 
that  variable  to  the  3-D-geometry  model  named  'Vehicle',  which  has  a  translation 
property.  Finally,  it  will  cause  the  object  'Vehicle'  to  translate  along  its  local  x-axis  by 
10  units.  It  is  assumed  here  that  the  developer  used  either  the  WorldUp  development 
enviroimient,  or  a  script  module  to  create  the  geometry  Vehicle. 

One  way  to  create  objects  in  WorldUp  is  by  directly  using  its  development 
environment.  In  this  case  the  Type  Browser  in  WorldUp  can  be  used.  For  example,  if 
the  user  wants  to  create  a  ball  using  the  Sphere  object  type  in  WorldUp,  properties  such 
as  Initial  Radius,  'Nlat',  and  'Nlong'  would  be  used  in  the  creation  process.  These 
properties  are  listed  in  the  Property  Browser  within  the  WorldUp  development 
environment.  The  other  way  to  create  objects  in  WorldUp  is  by  script  modules.  The 
following  code  demonstrates  how  to  create  a  ball  object,  using  the  Sphere  object  type  in 
WorldUp: 
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Dim  MyBall  as  new  Sphere 
Dim  ResultObject  as  Boolean 
MyBall.InitialRadius  =  10 
MyBall.NLat=  16 
MyBalI.NLong=16 

ResultObject  =  MyBall.Construct("Ball-l") 

In  the  above  code,  a  ball  called  Ball-1  has  a  radius  of  10  units,  and  the  Sphere  object 
type  was  used  to  create  it.  The  first  line  in  the  code  reserves  a  variable  called  'MyBall', 
as  a  'Sphere'  type.  The  third,  fourth,  and  the  fifth  lines  change  the  properties  of  the 
created  ball.  Then  the  last  line  creates  the  ball.  The  'Nlat',  and  'Nlong'  properties 
control  the  number  of  horizontal  and  vertical  segments  of  the  ball  geometry.  These  two 
properties  tell  how  smooth  the  ball  will  appear  during  the  simulation. 

5.5.5  WorldUp  Script  Supporting  Functions 

Since  WorldUp  was  built  as  a  tool  for  developing  simulation  based  on  real-time 
computer  graphics,  there  are  a  number  of  powerful  scripting  fimctions  that  the  developer 
can  use  in  developing  complex  simulations.  These  functions  were  organized  into  12 
different  groups.  For  example,  Figure  5-8  presents  the  most  commonly  used  groups  of 
scripting  functions  in  WoridUp  by  the  developer.  Global  functions  are  the  functions 
which  allow  the  developer  to  control  an  object  translations,  rotations,  or  orientation 
during  the  simulation.  Geometry  functions  are  those  by  which  the  developer  can  create 
objects,  or  modify  their  properties  during  the  simulation.  Path  functions  are  used  when 
the  developer  wants  an  object  to  follow  a  certain  path  during  the  simulation.  Sovmd 
functions  add  sound  effects  and  attach  sound  files  to  objects.  Viewpoint  functions  are 
the  functions  which  control  the  viewing  position  or  orientation.  Window-control 
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fiinctions  can  be  used  to  add  or  modify  a  window  since  it  is  the  only  GUI  element  that 
contains  a  viewpoint.  VBase  functions  are  used  to  declare,  or  cast  any  object.  Node 
functions  are  used  to  add,  delete,  or  refer  to  a  certain  object  in  a  group  node  in  the  scene 
graph  browser. 

Throughout  this  study,  many  of  WorldUp  script  supporting  functions  have  been 
used  extensively  to  develop  the  different  modules  in  SIMCON.  Modules  for  collision- 
detection,  avoid-obstacles,  and  terrain  following  were  developed  by  taking  advantage  of 
the  many  powerful  scripting  functions.  Intensive  use  of  WorldUp' s  supporting 
functions  made  the  development  of  these  modules  possible  within  the  time  allotted  for 
this  study. 


Figure  5-8:  The  WorldUp  script  supporting  fiinctions. 


CHAPTER  6 

METHODOLOGY  DEVELOPMENT  AND  DEMONSTRATION 

6.1  Introduction 

This  chapter  introduces  the  methodology,  which  has  been  developed  in  this 
research  to  simulate  construction  operations  using  virtual  environments.  This 
methodology  is  demonstrated  using  a  case  study,  Brian  Institute  Building  (UF  project 
#BR-147),  in  which  the  actual  construction  phase  started  June  1996  and  is  scheduled  to 
finish  in  July  1998.  Figure  6-1  presents  a  floor  plan  for  the  building  geometry. 


Figure  6-1 :  Floor  plan  of  the  case  study 
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Based  on  a  lump  sum  bid,  the  total  cost  of  the  project  is  $33  million  representing 
the  design,  construction,  and  the  installed  medical  equipment.  The  total  square-foot 
area  is  30,000,  and  the  total  as-built  construction  cost  is  about  $8  million  dollars. 

Several  visits  to  the  construction  site  and  communication  with  one  of  the 
construction  engineers  from  the  construction  company  (McDevitt  Bovis)  confirmed  that 
the  space  of  the  construction  site  is  considerably  limited,  several  equipment-based 
operations  were  delayed  from  the  beginning.  According  to  the  company's  scheduling 
data,  these  operations  were  delayed  because  of  their  nature  of  being  on  the  critical  path 
of  the  project,  which  is  quite  natural.  At  the  beginning  of  any  construction  project, 
operations  involve  the  utilization  of  heavy  equipment  as  a  primary  resource.  Once  the 
building  skeleton  has  been  built,  labor-based  operations  become  more  involved  and 
intensive.  Another  problem  resulting  from  the  limited  space  is  safety.  To  date,  no 
accidents  occurred  during  the  construction  phase.  However,  several  workers  on  the  site 
expressed  their  concern  for  safety.  Therefore,  daily  safety  meetings  were  scheduled. 

In  a  construction  project,  there  are  many  different  components  that  interact  with 
each  other  and  might  affect  an  operation.  These  components  (shown  in  Figure  6-2)  are: 
(1)  terrain;  (2)  building  components;  (3)  equipment;  (4)  labor;  (5)  material;  (6)  and 
environment.  Since  the  dynamics  involved  in  most  equipment-based  operations  is  the 
most  complex  element  to  describe,  SIMCON  was  developed.  The  main  feature  of 
SIMCON  is  that  it  can  be  used  in  a  similar  case  study. 


Terrain 

Equipment 

Environment 

Virtual  Environment 

Material 

Building  component 

Labor 

Figure  6-2:  Main  components  of  a  virtual  construction  environment. 
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6.2  The  Development  of  SIMCON 

This  section  presents  the  technique  used  to  develop  the  virtual  environment 
SIMCON  (illustrated  in  Figure  6-3).  The  first  stage  involved  the  utilization  of  a  CAD 
development  software  to  develop  the  3-D  models  representing  building  components, 
equipment  prototypes,  site  terrain,  and  other  models  representing  the  construction  site 
(illustrated  in  Figure  6-4).  The  3-D  CAD  modeling  tool  in  WorldUp  (WorldUp 
Modelere)  was  also  used  in  this  stage  to  add  the  required  graphical  attributes  such  as 
colors,  shades,  and  textures.  At  the  end  of  this  stage,  the  models  were  ready  for  the 
assembly  process,  which  has  been  done  in  the  WorldUp  development  environment. 

Based  on  an  object-oriented  modeling  technique  care  was  taken  during  the 
assembly  process  to  allow  maximum  flexibility  for  the  user  in  controlling  the  different 
equipment  prototypes.  Therefore,  the  hierarchical  relationship  among  objects  forming  a 
piece  of  equipment  was  considered  to  facilitate  maximum  control  by  the  user. 

Then  the  scripting  language  (BASIC  Script)  was  used  to  build  the  GUI  of 
SIMCON.  This  stage  involved  developing  a  technique  to  allow  the  user  to  select  the 
different  equipment  prototypes  in  the  enviroimient,  and  to  provide  a  user-application 
control  (illustrated  in  Figure  6-5).  Then  the  modules  for  machine  dynamics,  and  user- 
machine  control  were  developed  next.  The  main  concern  in  this  stage  was  to  develop  a 
general  approach  that  can  be  applied  in  similar  case  studies  rather  than  just  this 
particular  one.  Figure  6-6  depicts  this  stage.  Additionally,  Figure  6-7  presents  the 
outcome  of  all  above  stages,  which  is  the  virtual  environment  SIMCON.  In  SIMCON 
the  user  can  navigate  in  real-time  using  a  navigation  device  (such  as  a  Mouse),  control 
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each  equipment  prototype  using  a  controlling  device  (such  as  a  Joystick),  and  immerse 
himself/herself  into  the  environment  using  a  HMD  device.  The  simulation  then  turns 
into  virtual  reality.  The  following  sections  present  these  stages  in  more  detail. 


Development  of  3D  CAD 
Models 


1     Assembly  of  the  Virtual 
1  Environment 

1       Developing  the  GUI 

Adding  Behavior 

User 

O 


Figure  6-3:  Stages  involved  in  developing  SIMCON. 
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Development  of  3D  CAD 
Models 


Terrain 


0 

Equipment 


oaoa 
□□□□ 

□□□1= 

Building 


Material 


Environment 


Figure  6-4:  Development  of  SIMCON's  3-D  CAD  models 
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Developing  the  GUI 


User-Simcon  Control 


User-Machine  Control 


User-Simcon  Interface 


Basic  Script 


WorldUp  Development 
Environment 


Figure  6-5:  Development  of  SIMCON's  GUI. 
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Adding  Behavior 


BASIC  Script 


Equipment 


-J  Environment 


Labor 


Figure  6-6:  Adding  behavior  to  SIMCON's  models. 


Figure  6-7:  User-SIMCON  interaction  relationship. 
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6.3  The  Modeling  Process 

Since  the  modeling  process  is  the  first  process  to  start  when  building  a  virtual 
environment,  the  author  used  his  experience  in  AutoCAD  (R.13c4)  in  developing  the  3- 
D  CAD  models  representing  the  different  equipment  prototypes,  the  site  terrain,  and  the 
building.  Figure  6-8  presents  this  process. 


DXF  3DS 


Figure  6-8:  Steps  of  the  modeling  process. 
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Every  3-D  CAD  model,  representing  a  part  in  an  equipment  prototype,  was 
modeled  in  a  separate  layer  in  AutoCAD.  Thus,  the  developer  can  save  this  layer  in  a 
separate  drawing  file.  Unfortunately,  WorldUp  does  not  directly  support  the  famous 
AutoCAD  drawing  file  format  (DWG);  however,  it  does  support  other  formats.  Two  of 

these  formats  are  the  Drawing  Exchange  Format  (DXF),  and  the  3-D  STUDIO^  1  (3-DS) 
format.  The  3-DS  file  format  exports  the  model  fi-om  AutoCAD  since  this  file  format  is 
much  faster  to  be  processed.  Then  the  3-DS  file  representing  the  model  is  imported  into 
the  WorldUp  Modeler  program  in  order  to  add  the  preferred  colors  and  textures,  and 
then  saved  using  the  Natural  File  Format  (NFF)  that  is  supported  by  the  WorldUp' s 
development  environment.  Textures  were  added  to  the  different  3-D  CAD  models 
using  a  library  provided  with  WorldUp. 

6.3.1  Equipment  Models 

Since  each  model  was  created  based  on  a  number  of  many  polygon  meshes,  care 

was  taken  to  reduce  this  number,  and  to  keep  the  model  in  a  good  resolution.  For 
example,  a  truck  would  appear  as  a  truck  but  not  as  a  cube  and  two  cylinders.  Table  6-1 
presents  the  total  number  of  polygons  used  to  describe  each  machine  model.  It  should 
be  noted  that  during  this  stage,  the  3-D  CAD  models  were  continuously  tested  in 
SIMCON's  environment  for  achieving  the  fastest  and  the  most  representative  model  of 
each  type.  This  testing  involved  going  back  and  forth  between  the  Modeler  program 
and  the  development  environment  of  WorldUp.  In  addition,  texture  bitmaps  were  used 
to  replace  any  redundant  geometry  that  does  not  have  a  fimction  in  the  simulation.  For 

1 1  3D  STUDIO  is  a  registered  trademark  of  Autodesk  Corp. 
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example,  the  tower  crane  model  was  modeled  using  only  102  polygons,  because  the 
shape  of  that  piece  of  equipment,  can  be  represented  by  blocks  of  boxes  with  different 
side  dimensions.  Consequently,  the  other  three  equipment  models  were  modeled  using 
a  higher  number  of  polygon  meshes  since  they  have  many  irregular  surfaces. 


Table  6-1 :  3-D  CAD  models  used  to  represent  the  equipment  resource. 


Equipment  Resource  Type 

Number  of  Polygons 

Excavator 

2320 

Tower  Crane 

102 

Mobile  Crane 

2520 

Truck 

2336 

6.3.1.1  Truck  model 

Figure  6-9  represents  the  truck  model  in  SIMCON,  and  figures  6-10,  6-1 1,  and 

6-12  present  the  different  CAD  models  developed  for  the  different  parts  of  the  truck 
model.  These  models  were  originally  developed  using  AutoCAD  then  several 
procedures  were  applied  to  them  before  getting  them  in  their  final  shape.  Four  objects 
were  used  to  represent  the  function  of  this  model  in  the  virtual  environment. 


Truck  3D  Model 
 Base 

Upper  Body  Front  Body 

Wheels 


Figure  6-9:  The  truck  model. 


Ill 


Figure  6-10:  Base  and  body  objects  of  the  truck  model. 
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Figure  6-12:  The  wheel  object  of  the  truck  model. 
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6.3.1.2  Mobile  Crane  Model 

Figure  6-13  represents  the  mobile  crane  model  in  SIMCON,  and  figures  6-14  to 
6-20  present  the  different  parts  developed  for  mobile  crane  model.  They  were  originally 
developed  using  AutoCAD,  then  several  procedures  were  applied  to  them  before  getting 
the  model  in  its  final  shape.  Nine  objects  were  used  to  represent  the  function  of  this 
model  in  the  virtual  environment. 


Tires 

Mobil  Crane  3D  Model 


Rotation  Base 

Main  Boom 

Boom-2 

I  Driver  Cabin 

Boom-3 
Boom-4 

Grabber 


Body 


Wheels 


Figure  6-13:  The  mobile  crane  model. 


Figure  6-14:  The  body  object  of  the  mobile  crane  model. 


Figure  6-16:  The  main  boom  object  of  the  mobile  crane  model. 


Figure  6-18:  The  boom-3  object  of  the  mobile  crane  model. 


Figure  6-19:  The  boom-4  object  of  mobile  crane  model. 


Figure  6-20:  The  grabber  object  of  the  mobile  crane  model. 
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6.3.1.3  Excavator  model 


Figure  6-21  represents  the  excavator  model  in  SIMCON.    Seven  objects 
represent  the  model  as  shown  in  figures  6-22  to  6-28. 


Driver  Cabin 


Shoes 


Excavator  3D  Model 


Base 


v  -■'n 


Shoes 


Body. 


Boom 


Brace 


Driver  Cabin 


Bucket 


Figure  6-21 :  The  excavator  model. 


Figure  6-22:  The  base  object  of  the  excavator  model. 


Figure  6-23:  The  body  object  of  the  excavator  model. 


Figure  6-24:  The  driver  cabin  object  of  the  excavator  model. 


Figure  6-25: 


The  boom  object  of  the  excavator  model. 


Figure  6-26: 


The  brace  object  of  the  excavator  model. 


Figure  6-27:  The  bucket  object  of  the  excavator  model. 


Figure  6-28:  The  shoe  object  of  the  excavator  model. 
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6.3.1.4  Tower  crane  model 

Figure  6-29  represents  the  tower  crane  model,  which  was  modeled  in  the 
WorldUp  Modeler.  Seven  objects  were  used  to  represent  the  tower  crane  model  as 
shown  in  figures  6-30  to  6-36. 


Tower  Crane  3D  Model 

,  ' 

Static  Base  


I 

Fixed  Tower 

I 

Slewing  Ring 


Control  Cabin  ^  Boom 

Trolley  ^ — 


Grabber 


Counter  Weight 


Figure  6-29:  The  tower  crane  model. 
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Figure  6-32:  The  slewing  ring  object  of  the  tower  crane  model. 


Figure  6-33:  The  boom  object  of  the  tower  crane  model. 


Figure  6-34:  The  control  cabin  object  of  the  tower  crane  model. 


Figure  6-35:  The  counter  weight  object  of  the  tower  crane  model. 


4^ 


Figure  6-36:  The  trolley  object  of  the  tower  crane  model. 
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6.3.2  Terrain  Models 

The  basic  element  in  a  virtual  environment,  representing  a  construction  process, 
is  a  terrain  model.  All  other  models  representing  an  equipment  resource,  a  material 
resource,  or  a  building  component  use  the  terrain  model  as  a  physical  support  during  the 
simulation  [Opdenbosch  et  al.  1995].  In  other  words,  the  simulation  process  of  an 
equipment-based  operation  will  not  be  realistic  unless  there  is  a  terrain  model 
representing  the  construction  site. 

Although  non-graphical  simulation  techniques  did  not  represent  the  terrain 
topography  of  the  construction  site  in  their  methodologies,  graphical-based  techniques 
include  this  space  resource  in  the  simulation  process.  One  of  the  techniques  used  to 
include  a  terrain  representation  in  the  simulation  is  sculptured  surfaces  [OpdenBosch, 
1994].  Sculptured  surfaces  are  surfaces  generated  by  combining  a  number  of  cubic 
polynomial  curved  segments  together  [Foley  et  al.  1990].  One  of  the  advantages  of 
using  this  technique  is  the  ability  to  model  a  terrain  precisely;  however,  it  requires  a 
considerable  amount  of  matrix  calculations  especially  in  real-time  computations.  As  a 
result,  enormous  calculations  are  required  by  the  hardware  every  simulation  cycle. 
Another  technique  is  by  using  a  fractal  generation  module  in  a  graphics  package. 
Fractals  are  computer-generated  surfaces  patched  together  with  different  elevations 
[Foley  et  al.  1990].  Their  basic  drawing  primitive  is  a  group  of  straight-line  segments. 
Although  this  technique  can  be  used  to  generate  highly  defined  terrain  topography,  it 
requires  complex  programming  code  for  each  terrain  definition. 
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In  SIMCON  a  terrain  model  is  represented  as  a  surface  using  low-counts 
polygon  meshes;  thus,  eliminating  many  real-time  matrix  calculations  required  in 
drawing  the  terrain.  The  only  restriction  however,  is  the  capability  of  the  modeling  tool. 
Since  3-D  CAD  was  used  to  develop  the  different  models  representing  the  simulation 
process,  the  AutoCAD  3-D-mesh  generation  module  was  used  to  create  a  polygon-based 
terrain  with  different  elevations.  In  this  case  the  developer  must  choose  the  best  number 
of  polygons  describing  the  topography  of  the  terrain.  If  a  flat  terrain  is  to  be  included  in 
the  virtual  environment,  a  1  by  1  mesh  is  adequate.  However,  in  many  cases,  a  50  by  50 
polygon  mesh  gives  a  more  accurate  representation  especially  for  irregular  terrain 
models.  It  should  be  noted  that  the  higher  the  number  of  elements  on  each  side  of  the 
mesh,  the  higher  the  definition  of  the  site  topography,  and  the  higher  the  number  of  the 
real-time  calculations  required.  Figure  6-37  and  6-38  present  different  terrain  models 
developed  for  SIMCON. 


Figure  6-37:  The  flat  terrain  model. 


Figure  6-38:  The  irregular  terrain  model. 

6.3.3  Labor  Model 

The  labor  model,  shown  in  Figure  6-39,  was  originally  obtained  from  a  web  site 

on  the  Internet,  called  Avalon^^^  which  offers  many  3-D  CAD  models  free  of  charge. 
Reducing  the  niunber  of  polygons  using  the  WorldUp  Modeler  program  fiirther 
optimized  the  model.  Colors  were  added  then  to  the  model. 


Figure  6-39:  The  labor  model. 


12  The  address  of  this  web  site  is  http://  Avalonl.viewpoint.com 
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6.3.4  Material  Model 

Material  simulation  is  a  difficult  task  to  do  graphically,  because  of  the  quantiun 

nature  of  material.  Material  representation  in  SIMCON  is  based  therefore,  on  an 
uregular  3-D  spherical  model,  modeled  directly  usmg  the  WorldUp  Modeler. 
Additionally,  a  texture  of  gravel  was  added  to  the  model  until  it  reached  its  final  form 
shown  in  Figure  6-40. 


6.3.5  Environment  Models 

A  powerful  feature  in  graphical  simulation  techniques  is  the  ability  to  describe 
the  surrounding  environment.  In  representing  the  case  study,  there  are  a  number  of 
different  models  such  as  roads,  trees,  a  sky,  pipes,  etc.,  that  they  were  added  in  order  to 
achieve  more  realistic  views.  Figure  6-41  represents  the  road  model,  which  was 
modeled  as  a  3-D  face  inside  AutoCAD.  Figure  6-42  represents  a  tree  model,  which  has 


Figure  6-40:  The  material  model. 


1 

I 

I 
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been  modeled  first  in  AutoCAD  then  modified  in  WorldUp  Modeler.   Figures  6-43 
througii  6-45  represent  additional  environmental  models  used  in  SIMCON. 


Figure  6-4 1 :  The  road  model. 


Figure  6-42:  The  tree  model. 
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Figure  6-44:  The  fence  model. 


Figure  6-45:  The  sky  model. 
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6.3.6  Object  Oriented  Modeling  of  Building  Components 

One  of  the  most  advanced  features  in  SIMCON  is  the  abiUty  to  retrieve  any  3-D- 
CAD  model  representing  a  building.  Since  structural  and  architectural  CAD  models  are 
naturally  generated  during  the  design  phase  in  most  construction  projects,  SIMCON  has 
a  built-in  module  that  allows  the  user  to  retrieve  any  of  these  models  in  its  virtual 
environment.  It  is  recommended  to  utilize  the  object-oriented  modeling  technique  to 
represent  a  building  structure  and  its  component  such  as  a  beams,  columns,  and  slabs 
[Vanegas  et  al.  1994].  This  object-oriented  modeling  technique  should  follow  the  logic 
presented  in  Figure  5-46. 


Building  (Th*  Paranl  Object) 


Coluinn  (A  Child  Objwt) 


Beam,  (A  Child  Object) 


Figure  6-46:  Object-oriented  modeling  of  a  building. 

The  first  step  required  to  add  a  building  component  to  SIMCON's  virtual 
environment  is  to  reserve  an  imaginary  location  within  the  virtual  environment  using 
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the  dialog  shown  in  Figure  6-47.  Then,  any  building  component  can  be  then  imported 
to  SIMCON  using  the  dialog  shown  in  Figure  6-48. 


{Building  Construction 

m 

Building  ID 

Add  Building  | 

n 

Done 

Figure  6-47:  The  Building  dialog  box  in  SIMCON. 
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Done 


Figure  6-48:  The  'Add  Building  Component'  dialog  box  in  SIMCON. 

The  nature  of  the  dialog  shown  in  Figure  6-48  is  completely  passive,  which 
means  that  it  can  import  any  3-D-CAD  model  created  in  other  CAD  programs  like 
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AutoCAD  or  3-D  Studio^  3.  The  user  has  to  specify  the  global  location  of  the  building 
component  needed  to  be  placed  into  the  virtual  environment,  its  name,  and  an  integer 
number  representing  the  building  index.  Once  the  building  component  has  been  added 
to  the  building  definition,  it  becomes  a  child  object  of  that  building;  therefore,  a  change 
in  the  building  translation  or  rotation  vectors  will  change  its  components  as  a  result  with 
the  same  value.  Figures  6-49  to  6-51  represent  the  case  study  structure  model,  which 
was  modeled  initially  in  AutoCAD.  Textvires  were  then  added  to  the  model  using  the 
WorldUp  Modeler  program  and  then  added  to  SIMCON. 


Figure  6-49:  The  building  model  of  the  case  study. 


3D  Studio  is  a  registered  trademark  of  Autodesk  Corporation. 


Figure  6-5 1 :  North  side  view  of  the  building  model. 
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6.4  The  Assembly  Process 

This  section  introduces  the  second  stage,  which  was  involved  in  building  the 
virtual  environment  SIMCON.  After  developing  all  of  the  3-D  CAD  models 
representing  terrain,  building,  equipment,  and  other  elements  of  the  case  study,  the 
WorldUp  development  environment  was  used  to  assemble  the  virtual  enviroiunent  (refer 
to  Appendix  B  for  the  location  of  these  models). 

Based  on  the  object-oriented  modeling  technique,  all  objects  forming  a  machine 
type  were  grouped  together.  Each  group  name  was  given  the  name  of  the  prototype  that 
the  machine  represents.  For  example,  the  Truck  group  consists  of  all  objects  forming 
the  truck  model  such  as  the  upper-body,  front-body,  base,  and  wheels.  This  step  was 
done  by  declaring  a  Group  object  from  the  Type  Browser  in  the  World  Up  development 
environment  as  seen  in  Figure  6-52. 

Then  each  object  (part  of  a  3-D  CAD  model)  is  assigned  different  translation  and 
rotation  values  relative  to  other  objects  participating  in  representing  a  machine  model. 
This  process  was  done  using  the  Position  Object  dialog  box  in  the  WorldUp 
development  environment  (refer  to  Figure  6-53).  Then  these  translation  and  rotation 
values  are  stored  in  two  properties  (Translation,  and  Rotation)  as  shown  in  Figure  6-54. 
Once  each  group  representing  a  machine  prototype  has  been  assembled,  the  Scene 
Graph  Browser  in  WorldUp  will  indicate  that  group  using  a  circular  node  (as  shown  in 
Figure  6-55).  Once  the  developer  clicks  on  that  node,  the  hierarchical  distribution  of 
objects  will  be  shown.  For  example,  if  the  node  presenting  the  tower  crane  model  was 
clicked,  the  Scene  Graph  Browser  will  look  like  the  one  in  Figure  6-56.  The  same 
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technique  was  applied  to  all  objects  in  SIMCON.  Figures  6-57  through  6-59  present  the 
virtual  environment  from  different  views  showing  different  models. 
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Figure  6-52:  The  WorldUp  Type  Browser. 
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Figure  6-53:  The  WorldUp  'Position  Object'  dialog  box. 
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Figure  6-54:    The  WorldUp  Property  Browser. 
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Figure  6-55:    WorldUp's  Scene  Graph  Browser  showing  SIMCON's  groups. 


ij -Q  towetctane-l 

[=1  El  towei_ctane-base 

I  B  SI  towei_cfane-v 

I  Izl  SI  towef_cfane-ting 

i  fi  IS  towei_ciane-h 

j  i  @  towei_ctane-weight 

j  il  S]  towef_cfane-uppef 

I  ^  ^  towet_crane-dfivef 

j  S  SI  towet_ciane-gfabef 

i  ^  @  t-ciane-gtabei 


Figure  6-56:  Scene  Graph  Browser  showing  parts  of  the  tower  crane  model. 


Figure  6-57:  SIMCON  showing  a  Truck. 


Figure  6-58:  SIMCON  showing  a  labor  operation. 


Figure  6-59:  Fly-bird  view  of  the  site. 
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6.5  Development  of  SIMCON's  GUI 

The  graphical  user  interface  of  SIMCON  was  designed  takening  into 
consideration  efficiency  and  ease  in  usage.  It  was  written  using  the  BASIC  Script 
language  supported  by  WorldUp  (refer  to  Appendix  A  for  the  scripting  code,  and 
Appendix  C  for  the  location  of  the  scripting  modules).  It  consists  of  a  window,  which 
contains  the  virtual  environment  and  many  text-based  dialog  boxes  to  serve  as  an 
interface  to  the  user.  There  is  a  main  dialog  box,  'Main  Control',  which  contains 
several  selections  as  shown  in  Figure  6-60.  This  dialog  box  can  be  activated  using  the 
'n'  key  on  the  keyboard. 


SIMCON's  Main  Contiol  Dialog...  E3| 

IF                                                 ^  ^ 
Please  select  one  of  the  following: 

Disable  current  eQuioment  and  re-initialize  SIMCON  B 

OK 
Cancel 

B  Enable  serialJoystick  device 

B  Disable  serial  Joystick  device 

B Attache  the  serial  Joystick  device  to  an  equiprr>ent 

B  Change  view  to  the  current  equipment 

B  Change  view  to  Fly-Bird  view 

BView  task  scripts  for  the  active  equipment 

^rt^flaqs  parameters 

J 

Figure  6-60:  The  'Main  Control'  dialog  in  SIMCON. 

In  addition  to  the  'Main  Control  Dialog'  in  SIMCON,  there  are  more  than  20 
'Message  Windows'  that  appear  in  SIMCON  where  different  actions  take  place  such  as 
selecting  a  machine,  enabling  a  sensor,  disabling  a  sensor,  or  disabling  a  machine.  All 
of  these  dialogs  and  selection  windows  are  written  using  the  scripting  language  and 
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compiled  using  the  internal  BASIC  compiler  of  the  WorldUp  development 
environment.  Figures  6-61  and  6-62  show  some  of  these  dialog  interfaces. 


Machine  Control. 


Please  select  Machine  Type: 


OK 


I  Mobile  Crane 

TowetCrane  Cancel 
Excavator   


Figure  6-61:  The  'Machine-Selection'  dialog  in  SIMCON. 


Serial  Port  Selection  175 


;  Please  select  one  of  the 


Figure  6-62:  The  'Serial  Port  Selection'  dialog  in  SIMCON. 
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6.6  Assigning  Behavior 

The  last  process  in  developing  SIMCON  involved  the  development  of  script 
modules  to  assign  behavior  for  equipment  models.  Since  machine  objects  in  SIMCON 
were  designed  to  be  included  in  other  case  studies,  care  was  taken  to  write  a  general-use 
scripting  code  for  each  machine  prototype.  These  script  modules  were  written  to 
provide  a  representation  of  the  dynamic  movement  of  machines,  and  to  facilitate  user- 
machine  control.  Therefore,  each  machine  script  modules  has  two  main  sections.  The 
first  section  in  each  module  defines  how  the  user  controls  the  machine  through  the 
keyboard  or  using  a  serial  joystick;  and,  the  second  section  describes  the  machine 
dynamic  movements. 

6.6.1  Equipment  Dynamics 

In  SIMCON  each  machine  has  the  ability  to  move  on  either  a  flat  or  irregular 

terrain.  That  was  done  using  a  general  terrain-foUov^ng  algorithm,  which  force  the 
machine  to  be  on  the  terrain  and  follow  the  topography  every  simulation  cycle.  Based 
on  the  machine  and  terrain  characteristics,  the  final  variable  that  describes  the 
movement  of  the  machine  along  its  z-axis  is  speed. 

In  SIMCON  machines  are  controlled  using  a  non-autonomous  mode.  Thus  by 
using  a  keyboard  or  the  serial  joystick,  each  machine  can  be  translated  by  a  unit 
translation  vector  along  its  local  z-axis.  Figure  6-63  illustrates  the  coordinate  system  in 
SIMCON. 
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For  example,  the  following  sample  script  shows  that  the  speed  of  the  truck  will 

be  incremented  by  5  units  if  the  user  presses  the  'i'  button  on  the  keyboard  (assuming 

that  the  variable 'm'  is  declared  as  a  truck  machine): 

Declare  m  as  Truck 

Set  m  =  GetTruck  ('Truck-l') 

Declare  kb  as  KeyBoard 

Set  kb  GetKeyBoard  (' KeyBoard- 1') 

Set  kb.Key  =  Keylnputs 

If  kb.Key  =  "i"  Then 

m.  Speed  =  m.  Speed  +  5 

The  'kb.key'  is  the  variable  representing  the  keyboard  device.  Figure  6-64  represents 
the  coordinate  representation  of  a  machine  on  the  terrain  based  on  a  local  reference 
frame. 


Figure  6-64:  Machine  translation  vector  notation. 


149 

As  mentioned,  in  SIMCON  there  is  a  general  terrain-following  algorithm, 
applied  to  ail  moving  machines  on  a  terrain.  If  the  machine  is  assumed  to  follow  the 
tangent  of  the  terrain  profile,  each  machine  object  in  SIMCON  is  set  to  adjust  its  height 
every  simulation  cycle  according  to  the  highest  point  of  the  terrain  using  the  geometric 
midpoint  of  the  machine  as  a  reference.  In  every  simulation  cycle  there  is  a  3-D  normal 
vector  applied  from  that  geometric  midpoint  to  trigger  the  first  point  on  the  terrain 
beneath  it.  Once  this  point  is  calculated,  the  machine's  lowest  point  is  assigned  the  y- 
value  of  that  point.  At  this  point  the  machine  is  at  the  correct  elevation  on  the  terrain, 
but  its  orientation  on  both  the  x-axis  and  the  z-axis  is  different  fi-om  the  terrain  profile. 
Therefore,  another  3-D  vector  is  used  to  determine  the  orientation  of  the  next  point  on 
the  terrain  along  the  local  z-axis  of  the  machine  as  shown  in  Figure  6-65. 


Figure  6-65:  Side-view  of  a  machine  moving  uphill  on  a  terrain. 
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Similarly,  the  vector  is  used  to  determine  the  roll  angle  of  the  machine  on  the 
terrain  as  shown  in  Figure  6-66.  Therefore,  in  every  simulation  cycle,  this  algorithm 
insures  that  the  machine  will  follow  the  terrain  and  adjust  its  height,  its  pitching  angle 
(a),  and  its  rolling  angle  (9)  accordingly.  Figure  6-67  illustrates  the  terrain-following 
algorithm  applied  in  SIMCON. 


Figure  6-66:  Rear- view  of  a  machine  moving  uphill  on  a  terrain. 
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1            Translate  along  Z-Axis 

f 

Adjust  Machine  Height  above  the  Terrain 

> 

1 

1  Adjust  Machine  Twist  Angle  @  X-Axis  (a) 

f 

1   Adjust  Machine  Roll  Angle  @  Z-Axis  (6) 

Figure  6-67:  The  general  terrain-following  algorithm  in  SIMCON. 

6.6.2  Collision  Detection 

In  SIMCON  every  machine  script  module  has  a  list  of  object  names  in  the 

virtual  environment  that  is  checked  every  simulation  cycle  against  collision.  The 
WorldUp  scripting  language  (BASIC  Script)  has  a  powerful  function,  called 
'IntersectsMovable',  by  which  a  collision  between  two  objects  can  be  determined.  This 
function  has  been  used  in  every  machine  script  module  to  check  collisions  against 
envirorunental  objects  (such  as  tree,  pipe,  and  other  objects  on  the  terrain),  against  the 
building,  and  other  machines.  Therefore,  depending  on  the  list  of  object  names  declared 
in  each  machine  script,  a  collision-detection-waming  text-message  will  appear  on 
SIMCON's  window  during  the  simulation  cycle. 
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6.6.3  Labor  Simulation 

Simulating  the  dynamic  movement  of  workers  between  two  different  locations  is 
one  of  the  most  complex  tasks  that  traditional  simulation  techniques  do  not  provide 
visually  [Rodriguez  et  al.  1993].  In  SIMCON  labor  movement  between  two  different 
locations  is  simulated  using  a  General  Problem  Solving  (GPS)  algorithm.  This  reactive 
algorithm  consists  of  5  different  actions  (done  through  6  script  modules)  as  follows: 

•  find  target  and  move  towards  it 

•  if  obstacle  exists  on  the  path,  move  opposite  from  the  target  direction 

•  rotate  towards  a  free-obstacle  orientation 

•  move  forward 

•  find  target  and  move  towards  it 

The  first  step  is  to  move  the  worker  model  towards  the  target  as  shown  in  Figure  6- 
68.  That  was  done  using  the  two  orientation  vectors  of  station- 1  and  station-2. 


Figure  6-68:  The  GPS  algorithm  (model  movement  towards  a  target). 
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Then  if  the  model  finds  an  obstacle  on  the  path,  it  will  translate  opposite  fi-om  the  target 
location,  and  rotate  towards  an  obstacle-free  position  as  shown  in  Figure  6-69.  Then  the 
next  script  module  will  attempt  to  find  the  target  again  and  move  towards  it  as  shown  in 
Figure  6-70. 


Figure  6-69:  The  GPS  algorithm  (model  avoidance  of  an  obstacle). 


Figure  6-70:  The  GPS  algorithm  (model  correcting  its  path  towards  the  target). 
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6.6.4  Equipment  Control 

Machine  control  is  provided  in  SIMCON  using  either  a  keyboard  or  a  serial 

joystick.  Table  6-2  presents  the  controlling  buttons  on  the  keyboard  for  each  machine. 


Table  6-2:  Machine  Controls 


Machine  part 

Keyboard 
Button 

Action 

Truck 

I 

Move  forward  (translate  along  z-axis) 

K 

Turn  right  (+Yaw) 

J 

Turn  left  (-Yaw) 

M 

Move  backward  (-translate  along  z-axis) 

L 

Rotate  upper-body  (+Pitch) 

0 

Rotate  upper-body  (-Pitch) 

Excavator 

I 

Move  forward  (translate  along  z-axis) 

K 

Turn  right  (+Yaw) 

J 

Turn  left  (-Yaw) 

M 

Move  backward  (-translate  along  z-axis) 

P 

Rotate  (Body+Boom)  +Yaw 

0 

Rotate  (Body+Boom)  -Yaw 

L 

Rotate  Boom  (+Pitch) 

0 

Rotate  Boom  (-Pitch) 

Q 

Rotate  Brace  (+Pitch) 

w 

Rotate  Brace  (-Pitch) 

A 

Rotate  Bucket  (+Pitch) 

S 

Rotate  Bucket  (-Pitch) 

Mobile  Crane 

I 

Move  forward  (translate  along  z-axis) 

K 

Turn  right  (+Yaw) 

J 

Turn  left  (-Yaw) 

M 

Move  backward  (-translate  along  z-axis) 

P 

Rotate  (Body+Boom)  +Yaw 

0 

Rotate  (Body+Boom)  -Yaw 

L 

Rotate  (Boom)  +Pitch 

0 

Rotate  (Boom)  -Pitch 

Q 

Raise  Main  Boom 

w 

Lower  Main  Boom 

Tower  Crane 

K 

Turn  Boom  right  (+Yaw) 

J 

Turn  Boom  left  (-Yaw) 

0 

Move  Trolley  Forward 

L 

Move  Trolley  Backward 

I 

Raise  Grabber 

M 

Lower  Grabber 
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Additionally,  a  machine  can  be  controlled  using  a  joystick  connected  to  the 
serial  ports  of  the  computer.  Currently,  SIMCON  is  only  compatible  with  the 
THRUSTMASTER14  serial  joystick  shown  in  Figure  6-71. 


Figure  6-71:  The  THRUSTMASTER  serial  joystick  device  in  SIMCON. 

Table  6-3  presents  the  controlling  action  for  each  machine  in  SIMCON  using  the 
serial  joystick-controlling  device. 

14  THRUSTMASTER  is  a  registered  trademark  of  THRUSTMASTER  Inc. 
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Table  6-3:  Machine  Controls 


Machine  part 

Joystick 
Action 

A  A.' 

Action 

T*  1 

Truck 

Move  Stick  Forward 

Move  forward  (translate  along  z-axis) 

Move  Stick  to  the  Right 

Turn  right  (+Yaw) 

Move  Stick  to  the  Lett 

lum  lett  (-Yaw) 

Move  Stick  rJackward 

Move  backward  (-translate  along  z-axis) 

Move  Hat  Backward 

Rotate  upper-body  (+Pitch) 

Move  Hat  Forward 

Rotate  upper-body  (-Pitch) 

Press  Fire  Button 

Accelerate 

Press  Mid  Button 

Decelerate 

Excavator 

Move  Stick  Forward 

Move  forward  (translate  along  z-axis) 

Move  Stick  to  the  Kight 

Turn  right  (+Yaw) 

Move  btick  to  the  Lett 

1  urn  lett  (-  Y  aw) 

Move  Stick  Backward 

Move  backward  (-translate  along  z-axis) 

Move  Hat  to  the  Right 

Rotate  (Body+Boom)  +Yaw 

Move  Hat  to  the  Lett 

Rotate  (Body+Boom)  -  Yaw 

Move  Hat  Backward 

Rotate  Boom  (+ritch) 

Move  Hat  Forward 

Rotate  Boom  (-Pitch) 

Press  Fire  Button 

Accelerate 

rress  Mid  Button 

Decelerate 

Mobue  Crane 

Move  Stick  Forward 

Move  forward  (translate  along  z-axis) 

Move  Stick  to  the  Right 

Turn  right  (+Yaw) 

Move  Stick  to  the  Lett 

lum  left  (-Yaw) 

Move  Stick  Backward 

Move  backward  (-translate  along  z-axis) 

Move  Hat  to  the  Right 

Rotate  (Body+Boom)  +Yaw 

Move  Hat  to  the  Lett 

Rotate  (Body+Boom)  -Yaw 

Move  Hat  Backward 

Rotate  (Boom)  +ritch 

Move  Hat  Forward 

Rotate  (Boom)  -Fitch 

Press  Fire  Button 

Accelerate 

Press  Mid  Button 

Decelerate 

Tower  Crane 

Move  Hat  to  the  Right 

Turn  Boom  right  (+Yaw) 

Move  Hat  to  the  Left 

Turn  Boom  left  (-Yaw) 

Move  Hat  Backward 

Move  Trolley  Forward 

Move  Hat  Forward 

Move  Trolley  Backward 

Press  Fire  Button 

Raise  Grabber 

Press  Mid  Button 

Lower  Grabber 
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6.7  Navigation  Controls  in  SIMCON 

The  user  can  use  the  2D-Mouse  to  navigate  in  the  3-D  space  of  the  environment. 
This  kind  of  real-time  navigation  is  what  is  called  real-time  Fly-By  animation.  The 
viewer  in  this  case  is  the  user  who  uses  SIMCON,  and  the  viewer  position  is  the  final 
location  within  the  virtual  environment  where  the  viewer  stopped.  Navigating  within  a 
virtual  environment  buih  in  WorldUp  depends  on  the  device  being  used.  SIMCON  uses 
the  standard  2D-Mouse-pointing  device  for  navigation  within  its  virtual  environment. 
Figure  6-72  presents  the  relationship  between  the  navigation  device  events  and  the 
corresponding  viewing  actions  in  SIMCON.  In  addition,  Table  6-4  presents  the 
possible  2D-Mouse  clicking  events,  and  the  corresponding  viewing  actions. 


Table  6-4:  2D-Mouse  Clicking  /  3-D-Navigation  Actions 


2D-Mouse  Click  Event 

3  -D-Navigation/V  iewing 
Action 

Left  click  on  top  1/3  of  screen 

Move  forward 

Left  click  on  bottom  1/3  of  screen 

Move  backward 

Left  click  on  right  1/3  of  screen 

Viewer  yaw  right 

Left  click  on  left  1/3  of  screen 

Viewer  yaw  left 

Right  click  on  top  1/3  of  screen 

Move  up 

Right  click  on  bottom  1/3  of  screen 

Move  down 

Left  +  Right  click  on  left  1/3  of  screen 

Viewer  roll  left 

Left  +  Right  click  on  right  1/3  of  screen 

Viewer  roll  right 

Shift  +  Left  +  Right  click  on  top  1/3  of  screen 

Viewer  pitch  up 

Shift  +  Left  +  Right  click  on  bottom  1/3  of  screen 

Viewer  pitch  down 
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Figure  6-72:  Navigation  device  events/viewing  actions  relationship. 


6.8  User  Immersion  in  SIMCON 

As  discussed,  SIMCON  facilitates  three  types  of  user  interactions.  First,  by 
using  a  HMD  the  user  can  be  immersed  within  the  virtual  environment.  Once  the  user 
navigates  in  the  virtual  environment,  his  position  and  orientation  within  the 
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environment  are  mapped  back  to  the  HMD.  The  iGlasses^^  HMD  device  is  fully 
supported  in  SIMCON.  Second,  by  using  a  serial  Joystick  the  user  can  control  the 
equipment  models  during  the  simulation.  Similarly,  using  the  keyboard  to  allow  the 
user  both  environment  navigation,  and  equipment  control  during  the  simulation.  The 
combination  of  using  the  HMD,  and  the  joystick  gives  the  feeling  of  being  in  the 
envirormient  itself  This  illusion  is  called  immersion. 

6.9  Representation  of  Operation  Time  in  SIMCON 

The  concept  of  real-time  computer  graphics  should  not  cause  misunderstandings. 
Real  time  computer  graphics  means  that  the  rendering  process  is  happening  every 
moment.  Colors,  shades,  textures,  viewing  perspectives,  object's  translations,  object's 
rotations,  or  any  other  drawing  process  are  taking  place  every  moment  on  the  computer 
screen. 

The  use  of  real-time  computer  graphics  in  construction  simulation  should  not 
mean  in  any  way  that  the  time  involved  in  simulating  an  operation  is  exactly  the  same 
time  involved  in  that  operation  in  the  real  life.  If  this  was  the  case,  our  planning  and 
scheduling  problems  would  have  been  solved  many  years  ago  no  matter  the  cost 
involved.  An  exact  operation  time  depends  on  a  number  of  variables  such  as  the 
characteristics  of  each  machine  and  the  terrain.  Additionally,  it  depends  on  the 
performance  of  the  simulation  system.  If  machine  characteristics  are  assumed  to  be 
included  in  the  system  the  final  output  would  be  the  speed  of  the  machine.  Therefore,  a 


iGlasses  is  a  registered  trademark  of  Virtual  I-O  Personal  Display  Systems 
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variable  representing  the  speed  of  each  machine  was  included  in  SIMCON.  Having  this 
speed  variable  known  and  the  dimensions  of  the  terrain,  another  variable  representing 
the  traveled  distance  was  also  included  in  SIMCON.  Then  by  these  two  variables,  an 
estimation  of  the  time  involved  in  an  operation  can  be  determined.  The  simplest  way  to 
record  an  operation  time  in  SIMCON  is  done  using  two  timer  functions  that  record  both 
the  time  when  the  operation  started  and  when  it  was  completed.  The  time  difference  is 
then  displayed  on  the  screen.  Therefore,  to  record  an  operation  time  in  SIMCON,  the 
user  will  have  to  do  two  simple  operations.  First  he/she  must  press  the  'R'  button  on 
the  keyboard  to  activate  the  timer  in  SIMCON.  When  the  user  feels  that  the  operation  is 
completed,  he/she  should  press  the  'U'  button  on  the  keyboard  to  deactivate  the  timer; 
and  then,  SIMCON  will  present  the  time  difference  on  the  screen. 

Although  this  procedure  gives  some  kind  of  time  representation  for  any 
operation  to  be  simulated  in  SIMCON,  the  accuracy  of  this  operation  time  depends  on 
many  different  factors.  The  most  important  factor  is  the  performance  of  the  system 
itself.  For  example,  high  number  of  objects  in  the  virtual  envirormient  lowers  the 
accuracy  of  the  operation  time.  Moreover,  high  resolutions  of  the  window  displaying 
the  virtual  environment  lower  the  accuracy  of  the  operation  time.  This  problem  could 
be  solved  by  keeping  a  low  number  of  objects  in  the  virtual  environment,  or  by  using  a 
faster  graphics  display  hardware  system.  Since  there  are  many  factors  that  govern  the 
performance  of  displaying  a  virtual  envirormient,  the  factor  that  represents  all  of  these 
combined  factors  (colors,  resolution,  texture,  hardware  memory)  is  called  the  frame  rate, 
to  index  the  system's  performance  [Ribasky  et  al.  1994].  This  means,  that  if  the  virtual 
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environment  is  rendered  by  the  system  using  30  frames  per  second,  the  time 
representation  will  tend  to  be  accurate.  Therefore,  when  designing  a  virtual 
environment,  a  frame  rate  of  30  is  a  performance  target.  The  virtual  environment  of 
SIMCON  in  this  case  runs  on  a  frame  rate  equal  to  15  and  sometimes  less  than  that. 
With  the  continuous  advances  in  the  computer  hardware  technology  however,  it  is 
expected  that  in  less  than  one  year  (if  not  soon)  this  performance  will  exceed  30. 


CHAPTER  7 
CONCLUSION  AND  RECOMMENDATIONS 

7.1  Conclusion 

This  study  introduced  a  new  methodology  for  simulating  construction  operations 
using  virtual  environments.  Additionally,  it  presented  the  current  advances  in  today's 
technology,  through  which  the  technique  can  be  done  economically  using  an 
inexpensive  platform,  the  PC  platform.  Moreover,  based  on  a  case  study,  a  virtual 
environment,  called  SIMCON,  was  developed  in  order  to  validate  the  workability  of  the 
methodology.  The  order  in  which  the  methodology  was  demonstrated  should  provide 
the  necessary  guidelines  for  the  construction  industry  to  simulate  construction 
operations  in  virtual  environments. 

Based  on  the  object-oriented  modeling  concept,  the  study  demonstrated  how  the 
different  building  components  could  be  assembled  and  then  used  within  the  virtual 
environment.  By  taking  into  account  the  geometric  component  of  building  project,  the 
new  simulation  technique  allows  designers  to  see  how  the  actual  design  of  a  building 
affects  its  construction  process.  The  use  and  inclusion  of  geometric  objects  to  design 
the  simulation  model  is  one  of  the  characteristics  that  sets  this  technique  apart  from 
current  simulation  methods. 
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Since  the  dynamics  involved  in  equipment-based  construction  operations  is  too 
complex  to  be  described  using  traditional  simulation  techniques,  the  interactive 
simulation  environment  SIMCON  was  designed  to  represent  machine  dynamics  in 
simulating  these  operations.  Additionally,  the  representation  of  machine  dynamics  made 
this  simulation  technique  an  effective  planning  and  scheduling  tool  in  construction 
engineering.  Even  though  this  study  was  concentrated  on  the  case  study,  careful 
consideration  was  given  to  the  fact  that  the  virtual  simulation  environment  needs  to  be 
updated  and  maintained.  The  developed  application  is  not  only  an  application  that  has 
been  developed  using  latest  software  technology,  but  also  a  collection  of  work  that 
provides  both  users  and  developers  with  the  necessary  tools  to  create  new  virtual 
environments  for  other  projects. 

This  study  has  introduced  a  new  way  of  simulating  construction  operations  that 
impact  the  areas  of  construction  management  and  building  design.  Construction 
managers  and  contractors  will  benefit  from  the  new  approach,  because  they  will  be  able 
to  determine  the  effectiveness  of  different  construction  procedures.  Similarly,  design 
engineers  will  benefit  from  the  new  approach  since  it  allows  them  to  visualize  how  the 
building  geometry  can  influence  an  operation  during  the  construction  phase. 

The  interactive  virtual  environment,  SIMCON,  developed  in  this  study  is  a  good 
example  of  how  virtual  environments  can  be  built  for  construction  simulation  using  the 
personal  computer.  In  the  United  States  one  of  the  most  expensive  tasks  in  construction 
engineering  is  to  training  someone  to  use  a  new  equipment  prototype.  In  fact  many 
heavy-equipment  manufacturing  companies,  such  as  Caterpillar,  used  to  spend  millions 
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of  dollars  every  year  in  building  physical  models  and  new  prototypes.  Now,  based  on 
CAD  Caterpillar  is  using  virtual  environments  to  test  new  equipment  models  in  real  time 
imder  different  terrain  and  weather  conditions. 

7.2  Recommendations  for  Future  Research 

7.2.1  Intelligent  Machines 

Since  the  methodology  introduced  in  this  study  uses  techniques  from  many 

different  areas,  there  is  plenty  of  room  for  improvement.  Research  in  artificial 
intelligence  can  lead  to  new  environments  that  are  capable  of  providing  assistance  and 
advice  to  the  user.  Virtual  machines  can  be  taught  to  learn  how  to  perform  their  tasks 
more  efficiently.  The  knowledge  that  these  intelligent  machines  acquire  can  be  acquired, 
during  the  different  stages  of  the  learning  process,  to  give  the  user  the  option  of  choosing 
different  levels  of  expertise  of  a  virtiial  machine.  The  experience  of  the  machine  could  be 
thought  of  as  the  experience  of  the  machine  operator.  A  virtual  enviroimient  that  uses 
such  a  technique  could  provide  the  choice,  not  only  of  different  machine  types,  but  also 
different  operator  skills. 

7.2.2  Construction  Automation  and  Robotics 

Although  computer-based  automation  and  robotics  technologies  have  been  on 
very  few  construction  jobs,  more  research  is  still  needed  in  this  area.  In  the  area  of 
manufacturing  most  of  the  publicity  about  robotics  centers  aroimd  multijointed  robot  arm 
and  hand  mechanisms  that  are  attached  either  to  a  fixed  base  or  to  a  platform.  Although 
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construction  operations  are  one-of-a-kind  activities,  there  are  some  projects,  which  have 
repetitive  nature  such  as  highway  construction  and  high-rise  building  construction. 
Virtual  Reality  could  provide  an  inexpensive  testing  medium  for  future  research  in  this 
area. 


APPENDIX  A 
SIMCON'S  SCRIPTING  CODE 


SIMCON's  Main  GUI  Module 


The  University  of  Florida 
Department  of  Civil  Engineering 
SIMCON's  Main  GUI  Module 
Developed  by:  Khalid  K.  Naji 
1997 


Option  Base  1 

Public  visual  as  Boolean 
Public  dragging  as  BOOLEAN 
Public  machine_f lag  as  String 
Public  truck_is_on  as  Boolean 
Pviblic  mobilecrane_is_on  as  Boolean 
Public  tower_is_on  as  Boolean 
Public  excavator_is_on  as  Boolean 
Public  auto_machine  as  String 
Public  auto_mode  as  Boolean 
Public  s_bIsSimconUp  as  boolean 

Public  Function  SimconDlg (controlname$ ,  Simcon_action%,  suppvalue%) 
Integer 

SimconDlg  =  True 

Select  Case  Simcon_action% 
Case  1 

s_bIsSimconUp  =  True 

Case  2 

'   control  event 
Select  Case  controlname$ 
Case  "Continue" 

SimconDlg  =  False 
End  Select 


case  3 
case  4 
case  5 
case  6 


'  content  of  text /combo  box  changed 
'  control  gains  focus 
'  idle  message 
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'  dialog  box  has  been  moved 

End  Select 
End  Function 

Begin  Dialog  Simcon_Main_Window  ,, 268, 235, "Construction  Visualizer- 
SIMCON", .SimconDlg 

Picture  20,8,228,180, "C:\Naji\PhD\case- 
study\f igurel .bmp" , 0, .Simcon_Pic, 1 

PushButton  64, 208, 136, 14, "Click  me  to  Continue Continue 
End  Dialog 


Sub  Main  () 
auto_machine= " " 

auto_mode=False 

visual=False 

Dim  so  as  Sound 

Set  so=GetSound{"sound-l") 

so . Repeat=False 

so . Playing=True 

machine_flag= "nothing" 

truck_is_on=False 

mobilecrane_is_on=False 

excavator_is_on=False 

tower_is_on= False 

Dim  panel  as  Simcon_Main_Window 

Dialog  panel 

Dim  win  as  Window 

Set  win=GetWindow("window-l") 

win. NavBarOpt ions  NAVBARSHOW  +  NAVBARMENUHIDE 

Dim  action  as  Script 

Set  action=GetScript ( "CngmodeScript" ) 


If  action  is  not  nothing  Then 
dragging=False 

win. AddUserButton  action,   " ChangeMode " ,   "Switches  between 
drag  object  and  navigate  mode" 

win.SetUserButtonBitmap  "ChangeMode",  "BT_move.bmp" 

End  If 


Dim  actionl  as  Script 

Set  actionl=GetScript { " initialScript " ) 
Dim  action2  as  Script 

Set  action2=GetScript ( "selectionScript" ) 
Dim  actions  as  Script 

Set  actions =GetScript ( "buildingScript" ) 

Dim  action4  as  Script 

Set  action4=GetScript ("bcScript") 

Dim  actions  as  Script 

Set  action5=GetScript { "visualScript" ) 

Dim  actione  as  Script 

Set  action6=GetScript ( "un_visualScript" ) 
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Dim  action?  as  Script 

Set  action7=GetScript { "autonomousScript" ) 
Dim  actions  as  Script 

Set  action8=GetScript { "non_autonomousScript" ) 

win. AddUserButton  actionl,   "initial",   "initialize  positions  of 

equipment  within  VE" 

win . SetUserButtonBitmap  "initial",  "control.bmp" 

win. AddUserButton  action2,   "selection",   "machine  selection 

dialog" 

win. SetUserButtonBitmap  "selection",  "truck.bmp" 

win. AddUserButton  action3,    "building",    "construct  a  new  building 
definition " 

win. SetUserButtonBitmap  "building",  "building.bmp" 

win. AddUserButton  action4,   "be",   "add  a  building  component ( s ) " 

win . SetUserButtonBitmap  "be",  "bc.bmp" 

win. AddUserButton  actions,    "visual",    "view  from  machine 
location" 

win. SetUserButtonBitmap  "visual",  "eye.bmp" 

win. AddUserButton  actions,   "un_visual",    "un_view  from  machine 
location" 

win. SetUserButtonBitmap  "\in_visual" ,  "eye2.bmp" 

win. AddUserButton  action?,    "automode",    "enable  full  autonomous 

mode " 

win. SetUserButtonBitmap  "automode",  "auto.bmp" 
win . AddUserButton  actions,   "non_automode" ,   "disable  full 
autonomous  mode" 

win . SetUserButtonBitmap  "non_automode" ,    "non-auto. bmp" 


End  Sub 
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•VISUAL  Module,   for  adding  HMD  to  user 

Public  visual  as  Boolean 
Sub  Main  () 

visual=True 

Dim  s  as  script 

Set  s=GetScript ( "machine_viewScript" ) 
Dim  V  as  Viewpoint 
Set  v=GetViewpoint ( "machine_view" ) 
v.AddTask  s 
End  Sub 


'  UN- VISUAL  Module,   for  removing  HMD  from  user 
Public  visual  as  Boolean 
Sub  Main  () 

visual=False 

Dim  s  as  script 

Set  s=GetScript { "machine_viewScript" ) 
Dim  V  as  Viewpoint 
Set  v=GetViewpoint ( "machine_view" ) 
v.RemoveTask  s 
End  Sub 


'This  Module  is  for  Equipment  Selection  within  SIMCON's  GUI 

Option  Base  1 

Public  visual  as  Boolean 

Public  machine_flag  as  String 

Public  mobile_is_on  as  Boolean 

Public  which_machine  as  String 

Public  truck_is_on  as  Boolean 

Public  excavator_is_on  as  Boolean 

Public  tower_is_on  as  Boolean 

Public  s_bIsTruckUp  as  Boolean 

Public  s_bIsMobileUp  as  Boolean 

Public  s_bIsExcvUp  as  Boolean 

Public  s_bIsTowerUp  as  Boolean 

Public  Function  truckDlg (controlname$,  action%,  suppvalue%)  As  Integer 
truckDlg=True 
Select  Case  action% 
Case  1 

'   initialize  stuff 
s_bIsTruckUp=True 

Case  2 

'  control  event 
Select  Case  controlname$ 
Case  "ok" 

Dim  n  as  String 
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n=DlgText$ ( "truck_number " ) 
Dim  target_machine  as  String 
target_machine= " truck- " +n 
Dim  t  as  Truck 

set  t=GetTruck (target_machine) 

Dim  ts  as  Script 

set  ts=GetScript ( "truckscript" ) 

t.AddTask  ts 

Set 

ts=GetScript { " truck_terrain_f ollowingscript " ) 

t.AddTask  ts 
machine_f 1 ag= " truck " 
which_machine= "Truck- "  +  n 
truck_is_on=True 
truckdlg=False 
Case  "cancel" 

truckDlg=False 

MsgBox  "No  change  in  machine  control ..." 

End  Select 

case  3 

'  content  of  text/combo  box  changed 

case  4 

'  control  gains  focus 

case  5 

'  idle  message 

case  6 

'  dialog  box  has  been  moved 

End  Select 
End  Function 

Begin  Dialog  truckcontroldlg  ,, 118 , 55 , "Truck  Control  Dialog" ,. truckdlg 

OKButton  8,28,40,14, .ok 

CancelButton  72 , 28 , 40, 14 ,. cancel 

TextBox  76,4,36,12, . truck_number 

Text  8,4,60,8, "Control  of  Truck  #",.Textl 
End  Dialog 

Public  Function  mobileDlg (controlname$ ,  action%,  suppvalue%)  As 
Integer 

mobileDlg=True 

Select  Case  action% 
Case  1 

'   initialize  stuff 
s_bIsMobileUp  =  TRUE 

Case  2 

'  control  event 
Select  Case  controlname$ 
Case  "ok" 

Dim  n3  as  String 

n3=DlgText$ ( "mobilecrane_number" ) 

Dim  t3  as  MobileCrane 

Dim  target_machine3  as  String 


ll 
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targe t_machine3="mobilecrane- " +n3 

Set  t3=GetMobileCrane ( targe t_machine3) 

Dim  ts3  as  Script 

Set  ts3=GetScript ( "mobilecranescript" ) 

t3.AddTask  ts3 

Set 

ts3=GetScript ( "mobile_terrain_followingscript" ) 

t3.AddTask  ts3 
machine_f lag= "mobilecrane " 
which_machine="MobileCrane- "  +  n3 
mobile_is_on=True 
mobiledlg=False 
Case  "cancel" 

mobileDlg=False 

MsgBox  "No  change  in  machine  control..." 

End  Select 

case  3 

'  content  of  text/combo  box  changed 

case  4 

'  control  gains  focus 

case  5 

'  idle  message 

case  6 

'  dialog  box  has  been  moved 

End  Select 
End  Function 

Begin  Dialog  mobilecontroldlg  ,, 118, 55, "Mobile  Crane  Control 
Dialog", .mobiledlg 

OKButton  8,28,40,14, .ok 

CancelButton  72,28,40,14, . cancel 

TextBox  76,4,36,12, .mobilecrane_number 

Text  8,4,60,8, "Control  of  Mobile  Crane  #",.Textl 
End  Dialog 

Public  Function  excvDlg (controlname$,  action%,   suppvalue%)  As  Integer 
excvDlg=True 
Select  Case  action% 
Case  1 

'  initialize  stuff 
s_bIsExcvUp=True 

Case  2 

'   control  event 
Select  Case  controlname$ 
Case  "ok" 

Dim  n6  as  String 

n6=DlgText$ { "excavator_number" ) 

Dim  t6  as  Excavator 

Dim  target_machine6  as  String 

target_machine6= "excavator- "+n6 

Set  t6=Getexcavator (targe t_machine6) 

Dim  ts6  as  Script 

Set  ts6=GetScript ( "excavatorscript" ) 
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te.AddTask  ts6 
Set 

ts6=GetScript ( "excv_terrain_f ollowingscript" ) 

te.AddTask  ts6 
machine_flag=" excavator" 
which_machine= "Excavator- "  +  n6 
excavator_is_on=True 
excvdlg=False 
Case  "cancel" 

excvDlg=False 

MsgBox  "No  change  in  machine  control ..." 

End  Select 

case  3 

'  content  of  text/combo  box  changed 

case  4 

'  control  gains  focus 

case  5 

'   idle  message 

case  6 

'  dialog  box  has  been  moved 

End  Select 
End  Function 

Begin  Dialog  excavatorcontroldlg      136, 54, "Excavator  Control 
Dialog", .excvdlg 

OKButton  8,32,40,14, .ok 

CancelButton  84,32,40,14, . cancel 

TextBox  88,8,36,12, . excavator_number 

Text  8, 8, 72, 8, "Control  of  Excavator  #",.Textl 
End  Dialog 

Public  Function  towerDlg {controlname$ ,  action%,  suppvalue%)  As  Integer 
towerDlg=True 
Select  Case  action% 
Case  1 

'   initialize  stuff 
s_bIsTowerUp=True 

Case  2 

'  control  event 
Select  Case  controlname$ 
Case  "ok" 

Dim  n7  as  String 

n7  =  DlgText$ ( "tower_number" ) 

Dim  target_machine7  as  String 

target_machine7= " TowerCrane- " +n7 

Dim  t7  as  TowerCrane 

Set  t7=GetTowerCrane ( targe t_machine) 

Dim  ts7  as  Script 

Set  ts7=GetScript { "TowerCranescript " ) 

t7.AddTask  ts7 

Set 

ts7=GetScript ( "tower_terrain_f ollowingscript" ) 


t7.AddTask  ts7 
tower_is_on=True 
machine_f lag= " towercrane " 
which_machine="TowerCrane- "  +  n7 
towerDlg=False 
Case  "cancel" 

towerDlg=False 

End  Select 

case  3 

'  content  of  text/combo  box  changed 

case  4 

'  control  gains  focus 

case  5 

'   idle  message 

case  6 

'  dialog  box  has  been  moved 

End  Select 
End  Function 


Begin  Dialog  towercontroldlg  ,, 151, 50, "Tower  Crane  Control 
Dialog", . towerdlg 

OKButton  8,28,40,14, .ok 

CancelButton  100,28,40,14, .cancel 

TextBox  104 , 4 , 36 , 12 , . tower_number 

Text  8, 4, 88, 12, "Control  of  Tower  Crane  #",.Textl 
End  Dialog 
Sub  MainO 

message  machine_flag 
Dim  mo  as  MotionLink 
Dim  a$ (5) 
a$ (1) ="Truck" 
a$ (2) ="Mobile  Crane" 
a$(3)="Tower  Crane" 
a$ (4) = "Excavator" 
result%=SelectBox{ "Machine  Control ...", "Please  select  Machine 
Type:",a$) 

Select  Case  result% 
Case  1 

MsgBox  "You  have  selected:   "  &  a$(result%) 
Dim  panel  as  truckcontroldlg 
Dialog  panel 

'  set  mo=GetMotionLink  ( "MotionLink-2  " ) 
' mo . Enabled=True 

case  2 

MsgBox  "You  have  selected:   "  &  a${result%) 
Dim  panel2  as  mobilecontroldlg 
Dialog  panel2 

' set  mo=GetMotionLink ( "MotionLink-3 " ) 
' mo . Enabled=True 

case  3 

MsgBox  "You  have  selected:   "  &  a$(result%) 
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Dim  panels  as  towercontroldlg 
Dialog  panels 

' set  mo=GetMotionLink ( "MotionLink-S " ) 
' mo . Enabled=True 

case  4 

MsgBox  "You  have  selected:  "  &  a$ {result%) 
Dim  panel4  as  excavatorcontroldlg 
Dialog  panel4 

' set  mo=GetMotionLink ( "MotionLink-4") 
' mo . Enabled=True 

case  5 
end  select 

End  Sub 


'This  Module  is  used  to  initialize  all  equipment 
'and  their  positions  within  the  Virtual  Environment 
Option  Base  1 

Public  machine_flag  as  String 
Piiblic  truck_is_on  as  Boolean 
Public  mobile_is_on  as  Boolean 
Public  excavator_is_on  as  Boolean 
Public  tower_is_on  as  Boolean 
Public  which_machine  as  String 

Sub  Main  {) 

Dim  mo  as  MotionLink 

s$  =  AskBox$ ( "What  machine  type  you  want  to  turn  it's  control 
off  ?.  ") 

MsgBox  "Turn  off  the  control  for:   "  &  s$ 

Select  Case  s$ 

Case  "truck" 

Dim  tl  as  Truck 

Set  tl=GetTruck (which_machine) 

Dim  si  as  Script 

Set  sl=GetScript { "truckscript" ) 

tl . removetask  si 

Set  sl=GetScript ( " truck_terrain_f ollowingscript " ) 
tl . RemoveTask  si 
truck_is_on=False 
Case  "mobilecrane" 

Dim  ml  as  Mobilecrane 

Set  ml=GetMobilecrane (which_machine) 

Dim  s2  as  Script 

Set  s2=GetScript ( "mobilecranescript" ) 
ml . RemoveTask  s2 

Set  s2=GetScript ( "mobile_terrain_f ollowingscript " ) 
ml . RemoveTask  s2 
mobile  is  on=False 
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Case  "excavator" 

Dim  el  as  Excavator 

Set  el=GetExcavator (which_machine) 

Dim  s3  as  Script 

Set  s3=GetScript ( "excavatorscript" ) 
el . RemoveTask  s3 

Set  s3=GetScript ( "excv_terrain_f ollowingscript" ) 
el . RemoveTask  s3 
excavator_is_on=False 
Case  "towercrane" 

Dim  tol  as  TowerCrane 

Set  tol=GetTowerCrane (which_ma chine) 

Dim  s4  as  Script 

Set  s4=GetScript ( "TowerCranescript" ) 
tol . RemoveTask  s4 

Set  s4=GetScript ( "tower_terrain_f ollowingscript" ) 
tol . RemoveTask  s4 
tower_is_on=False 
Case  Else 

MsgBox  "No  machine  was  turned  off ..." 

End  Select 

s=MsgBox(  "Do  you  want  to  initialize  SIMCON...?",   ebYesNo,  "SIMCON 
Initialization. . . ") 
If  s=6  Then 

machine_f lag= "nothing" 
Elself  s=7  Then 

machine_f 1 ag= " nothing " 

End  If 

Set  mo=GetMotionLink { "MotionLink- 2 " ) 
mo . Enabled=False 

Set  mo=GetMotionLink ( "MotionLink- 3 " ) 
mo . Enabled=False 

Set  mo=GetMotionLink { "MotionLink-4 " ) 
mo . Enabled=False 

Set  mo=GetMotionLink { "MotionLink- 5 " ) 
mo . Enabled=False 
End  Sub 


'  This  Task_Module  is  used  for  making  the  Sky  Object  Rotates 
'  around  the  virtual  environment 
Sub  Task   (s  as  sky) 

Set  s=GetSky ("sky-1") 

s . yaw  1 
End  S\ib 


'  This  Task_Module  is  for  adding  Sound  effects  to 

'  the  equipment  in  SIMCON 

Public  accel  as  Single 

Public  which_machine  as  String 

Piiblic  machine_flag  as  String 

Sub  Task(soso  as  Sound) 

Set  soso=GetSound ( " sound- 2 " ) 
Select  Case  machine_flag 
Case  "truck" 

Dim  t  as  Truck 

Set  t=GetTruck {which_machine) 
accel=t .Acceleration 
Select  Case  accel 
Case  is  =  0 

soso . Playing=False 
soso . Repeat=False 
Case  is  >  0 

soso . Playing=True 
soso . Repeat=True 
Case  is  <  0 

soso . Playing=True 
soso . Repeat=True 

End  Select 
Case  "mobilecrane" 

Dim  m  as  Mobilecrane 
Set  m=GetMobilecrane (which_machine) 
accel=m . Acceleration 
Select  Case  accel 
Case  is  =  0 

soso . Playing=False 
soso . Repeat=False 
Case  is  >  0 

soso . Playing=True 
soso . Repeat=True 
Case  is  <  0 

soso . Playing=True 
soso . Repeat=True 

End  Select 
Case  "excavator" 

Dim  e  as  Excavator 
Set  e=GetExcavator (which_machine) 
accel=e . Acceleration 
Select  Case  accel 
Case  is  =  0 

soso . Playing=False 
soso . Repeat=False 
Case  is  >  0 

soso . Playing=True 
soso . Repeat=True 
Case  is  <  0 

soso . Playing=True 


soso . Repeat=True 

End  Select 
case  "towercrane" 

Dim  w  as  TowerCrane 
Set  w=GetTowerCrane (which_machine) 
accel=w . Acceleration 
Select  Case  accel 
Case  is  =  0 

soso . Playing=False 
soso . Repeat=False 
Case  is  >  0 

soso . Playing=True 
soso . Repeat=True 
Case  is  <  0 

soso . Playing=True 
soso . Repeat=True 

End  Select 

End  Select 
End  Sub 


'  This  Module  is  to  allow  the  user  to  pick  an  object 
Global  dragging  as  Boolean 

Sub  Main  () 

Dim  pos  as  Iterator 

Dim  link  as  MotionLink 

Set  link=GetFirstMotionLink {  pos  ) 

Dim  win  as  Window 

Set  win=GetWindow (  "Window- 1"  ) 

If  dragging  Then 

win . SetUserButtonBitmap  "ChangeMode " ,    "BT_move . bmp" 

link . Enabled=True 

dragging=False 

Else 

win. SetUserButtonBitmap  "ChangeMode",  "BT_drag.bmp" 

link.Enabled=False 

dragging=True 

end  if 
End  Sub 
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'KeyBoard  Module 

'Algorithm  to  register  the  KeyBoard  device  for  SIMCON 
Suh  Task   (obj  as  KeyBoard) 

Ob j . Key  =  GetKey ( ) 
End  Sub 


'This  Task  Module  is  for  displaying  information 

'on  SIMCON' s  main  GUI  window 

Public  which_machine  as  String 

Public  machine_flag  as  String 

Public  auto_mode  as  Boolean 

Public  auto_flag  as  String 

Public  auto_machine  as  String 

Sub  Task(  me  as  window  ) 


Dim  iter  as  Iterator 
Dim  obj  as  BC 
Set  obj =GetFirstBC (iter) 
Select  Case  machine_flag 
Case  "nothing" 

me.Setcolor  1,0,0 
me.Drawtext  .05,  .95, 
Interactive  Visualizer" 

me.Drawtext  .05,  .90, 
Developed  by  Khalid  Kamal  Naji" 

me.Setcolor  1,0,0 


me . Drawtext 
me .Drawtext 


.05, 
.05, 


.10, 
.05, 


"Welcome  to  SIMCON,  the 
"A  WorldUP  Application 


"No  machine  in  control ..." 
"Select  Autonomous  or  Non- 


Autonomous  Mode" 
Case 


•truck" 

Dim  m  as  Truck 

Dim  machine_ori  as  Orientation 
Dim  truck_angle  as  Single 
Dim  accel  as  Single 
Dim  pos  as  Vect3d 
If  auto_f lag="truck"  Then 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .05,  auto_machine 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .10,    "Autonomous  Mode" 
Set  m=GetTruck (auto_machine) 
m.GetRotation  machine_ori 
truck_angle=OrientAngle (machine_ori) 
truck_angle=truck_angle*180/PI 
accel =m. Acceleration 
m.GetTranslation  pos 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .95,    "Speed=  "  +  str$ (accel) 


mph" 
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str$ (machine_ori . x) 
str$ (machine_ori . y ) 
str$ (machine_ori . z) 
str$ (truck_angle) 


Else 


+  "  mph" 


str$ (machine_ori .x) 
str$ (machine_ori .y) 
str$ (machine_ori . z) 
str$ (truckangle) 


me.Setcolor  0,1,0 

me.Drawtext  .05,  .90,  "X-Pos=  "  +  str$(pos.x) 
me.Setcolor  0,1,0 

me.Drawtext  .05,  .85,  "Y-Pos=  "  +  str$(pos.y) 
me.Setcolor  0,1,0 

me.Drawtext  .05,  .80,  "Z-Pos=  "  +  str$(pos.z) 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .75,  "X-Orient=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .70,  "Y-Orient=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .65,  "Z-Orient=  "  + 

me.Setcolor  0,1,0 

me.Drawtext  .05,   .60,  "Angle=  "  + 


me.Setcolor  0,1,0 

me.Drawtext  .05,    .05,  which_machine 
Set  m=GetTruck (which_machine) 
m.GetRotation  machine_ori 
truck_angle=Or ientAngle {machine_or i ) 
truck_angle=truck_angle*180/PI 
accel=m . Acceleration 
m.GetTranslation  pos 
me.Setcolor  0,1,0 

me.Drawtext  .05,  .95,  "Speed=  "  +  str${accel) 
me.Setcolor  0,1,0 

me.Drawtext  .05,  .90,  "X-Pos=  "  +  str$(pos.x) 
me.Setcolor  0,1,0 

me.Drawtext  .05,  .85,  "Y-Pos=  "  +  str$(pos.y) 
me.Setcolor  0,1,0 

me.Drawtext  .05,  .80,  "Z-Pos=  "  +  str$(pos.z) 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .75,    "X-Orient=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .70,    "Y-Orient=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .65,    "Z-Orient=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .60,    "Angle=  "  + 


End  If 
Case  "mobilecrane" 

Dim  ml_g  as  Graber 
Dim  ml  as  Mobilecrane 


Dim  machine_oril  as  Orientation 
Dim  accel_m  as  Single 
Dim  pos_m  as  Vect3d 
If  auto_flag= "mobile"  Then 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .05,  which_machine 
Set  ml_g=GetGraber ( "m-crane-graber" ) 
Set  ml=GetMobilecrane (which_machine) 
ml .GetRotation  machine_oril 
accel_m=ml .Acceleration  , 
ml .GetTranslation  pos_m 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .95,    "Speed=  "  + 

str$ (accel_m)  +  "  mph" 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .90,    "X-Pos=  "  + 

str$ (pos_m.x) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .85,   "Y-Pos=  "  + 

str$ (pos_m.y) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .80,    "Z-Pos=  "  + 

str$ (pos_m. z) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .75,   "X-Orient=  "  + 

str$ (machine_oril .x) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .70,    "Y-Orient=  "  + 

str$ (machine_oril . y) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .65,    "Z-Orient=  "  + 

str$ (machine_oril . z) 

Else 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .05,  which_machine 
Set  ml_g=GetGraber { "m-crane-graber" ) 
Set  ml=GetMobilecrane (which_machine) 
ml .GetRotation  machine_oril 
accel_m=ml .Acceleration 
ml. GetTranslation  pos_m 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .95,   "Speed=  "  + 

str$ (accel_m)   +  "  mph" 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .90,    "X-Pos=  "  + 

str$ (pos_m.x) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .85,    "Y-Pos=  "  + 

str$ {pos_m.y) 

me.Setcolor  0,1,0 

me.Drawtext   .05,    .80,    "Z-Pos=  "  + 

str$ (pos_m. z) 


me.Setcolor  0,1,0 

me.Drawtext  .05,    .75,   "X-Orient=  "  + 

str$ {machine_oril .x) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .70,    "y-Orient=  "  + 

str$ (machineoril .y) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .65,    "Z-Orient=  "  + 

str$ {machine_oril . z) 

End  If 
Case  "excavator" 

Dim  m2  as  Excavator 
Dim  machine_ori2  as  Orientation 
Dim  accel_e  as  Single 
Dim  pos_e  as  Vect3d 
If  auto_f lag="excv"  Then 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .05,  which_raachine 
Set  m2=GetExcavator (which_machine) 
m2 .GetRotation  machine_ori2 
accel_e=m2 .Acceleration 
m2 .GetTranslation  pos_e 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .95,    "Speed=  "  + 

str$ (accel_e)   +  "  mph" 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .90,    "X-Pos=  "  + 

str$ {pos_e.x) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .85,    "Y-Pos=  "  + 

str$ (pos_e .y) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .80,    "Z-Pos=  "  + 

str$ (pos_e. z) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .75,    "X-Orient=  "  + 

str$ (machine_ori2 .x) 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .70,   "Y-Orient=  "  + 
str$ {machine_ori2 . y )  , 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .65,    "Z-Orient=  "  + 

str$ (machine_ori2 . z) 

Else 

me.Setcolor  0,1,0 

me.Drawtext  .05,    .05,  which_machine 
Set  m2=GetExcavator (which_machine) 
m2 .GetRotation  machine_ori2 
accel_e=m2 .Acceleration 
m2 .GetTranslation  pos_e 
me.Setcolor  0,1,0 


str$ (accel_e)   +  "  mph" 

str$ (pos_e .x) 

str$ (pos_e .y) 

str$ (pos_e . z) 

str$ (machine_ori2 .x) 

str$ (machine_ori2 .y) 


me.Drawtext  .05,    .95,  "Speed=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .90,  "X-Pos=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .85,  "Y-Pos=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .80,  "Z-Pos=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,  .75,  "X-Orient=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,  .70,  "Y-Orient=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .65,  "Z-Orient=  "  + 


str$ (machine_ori2 . z) 

End  If 

Case  "towercrane" 

me.Setcolor  0,1,0 


str$ (pos_w.x) 
str$ (pos_w.y) 
str$ (pos_w. z) 
Rotation  ®  Y- Axis' 


me.Drawtext  .05,    .05,  which_machine 
Dim  m3  as  TowerCrane 
Set  m3=GetTowerCrane (which_machine) 
Dim  m4  as  Machine 

Set  m4=GetMachine { "tower_crane-ring" ) 

Dim  machine_ori3  as  Orientation 

m3 .GetRotation  machine_ori3 

Dim  pos_w  as  Vect3d 

m3 .GetTranslation  pos_w 

Dim  machine_ori4  as  Orientation 

m4 .GetRotation  machine_ori4 

Dim  angle  as  Single 

angle=OrientAngle (machine_ori4) 

angle=angle*180/PI 

me.Setcolor  0,1,0 

me.Drawtext  .05,  .95,  "Vertical  Tower  Data" 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .90,    "X-Pos=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .85,    "Y-Pos=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .80,    "Z-Pos=  "  + 
me.Setcolor  0,1,0 

me.Drawtext  .05,    .75,    "Horizontal  Boom 
me.Setcolor  0,1,0 


me.Drawtext  .05,    .70,  "Y-Rotation= 
Format$ (angle, "###")  +  "  degrees" 

Case  Else 

me.Setcolor  1,0,0 

me.Drawtext  .05,    .05,    "No  machine 

control ..." 

End  Select 

End  Sub 

'This  Task_Module  is  for  registring  the  Mouse  device 
'for  SIMCON's  GUI 
S\ib  Task(m  as  Mouse) 

Dim  g  as  Geometry 

Dim  p  as  vect2d 

Dim  w  as  window 

Dim  geom  as  Vect3d 

Set  w=GetFirstWindow() 

m. GetPosition  p 

Set  g=PickGeometry (p) 

'g. width  geom.x 

If  g  is  not  nothing  Then 
message  g.Name 

End  If 
End  Sub 


'This  Module  is  to  make  SIMCON  runs 
' in  Full  Autonomous  Mode  Algorithm 
Option  Base  1 

Pxiblic  auto_mode  as  Boolean 
Public  auto_machine  as  String 
Public  auto_flag  as  String 
Siib  Main  () 

Dim  tr  as  Truck 

Dim  mb  as  Mobilecrane 

Dim  ex  as  Excavator 

Dim  tw  as  Towercrane 

Dim  sr  as  Script 


Select  Case  autoflag 
Case  "truck" 

Set  tr=GetTruck (auto_machine) 
Set  sr=tr.Job 
tr .RemoveTask  sr 

MsgBox  "Disabling  Truck  autonomous  mode. 
auto_machine= "nothing" 
auto_mode=False 
auto_f 1 ag= " nothing " 
Case  "mobilecrane" 

Set  mb=GetMobileCrane {auto_machine) 
Set  sr=mb.Job 
mb . RemoveTask  sr 


MsgBox  "Disabling  Mobile  Crane  autonomous  mode. 


auto_machine= "nothing" 
auto_mode=False 
auto_flag= "nothing" 
Case  "excavator" 

Set  ex=GetExcavator (auto_machine) 
Set  sr=ex.Job 
ex . RemoveTask  sr 

MsgBox  "Disabling  Excavator  autonomous  mode..." 
auto_machine= "nothing" 
auto_mode=False 
auto_f lag= "nothing" 
Case  "towercrane" 

Set  tw=GetTowercrane {auto_machine) 
Set  sr=tw.Job 
tw. RemoveTask  sr 

MsgBox  "Disabling  Tower  Crane  autonomous  mode..." 
auto_machine=" nothing" 
auto_mode=False 
auto_f lag= " nothing" 
Case  Else 

Exit  Sub 
End  Select, End  Svib 


'This  Module  is  to  make  SIMCON  runs 
' in  Non-Autonomous  Mode  Algorithm 
Option  Base  1 

Public  auto_mode  as  Boolean 

Public  auto_flag  as  String 

Public  auto_machine  as  String 

Public  s_bIstruck_MachineUp  as  Boolean 

Public  s_bIsmobile_MachineUp  as  Boolean 

Public  s_bIsexcv_MachineUp  as  Boolean 

Public  s_bIstower_MachineUp  as  Boolean 

Public  Function  truck_machineDlg (controlname$ ,  action%,  suppvalue%) 
Integer 

truck_machineDlg=True 

Select  Case  action% 
Case  1 

'   initialize  stuff 
s_bIstruck_MachineUp=True 

Case  2 

'   control  event 
Select  Case  controlname$ 
Case  "ok" 

auto_f 1 ag= " t ruck " 

auto_machine=DlgText$ { "truck_number" ) 
Dim  truck_target  as  String 
truck_target=DlgText$ ( "target_name" ) 


Dim  t  as  Truck 

Set  t=GetTruck (auto_machine) 

t . GoingTo=truck_target 

Dim  job  as  Script 

Set 

job=GetScript ( "truck_going_to_targetscript" ) 

t.AddTask  job 
Set  t.job=job 
auto_mode=True 
truck_machineDlg=False 
Case  "cancel" 

truck_machineDlg=False 

MsgBox  "No  machine  was  selected  for 

autonomous  mode ..." 

End  Select 

case  3 

'  content  of  text/combo  box  changed 

case  4 

'  control  gains  focus 

case  5 

'   idle  message 

case  6 

'  dialog  box  has  been  moved 

End  Select 
End  Fxmction 

Begin  Dialog  truck_machine_targetdlg  ,, 116, 81, "Autonomous 
Mode", . truck_machinedlg 

OKButton  8,60,40,14, .ok 

CancelButton  68 , 60, 40, 14 ,. cancel 

Text  8, 8, 60, 8, "Truck  number :", .Text 2 

TextBox  72,8,36,12, . truck_number 

Text  8,24,104,8, "Going  to  target :",. Text3 

TextBox  8,36, 100 , 12 , . target_name 
End  Dialog 

Public  Function  mobile_machineDlg (controlname$ ,  action%,  suppvalue%) 
As  Integer 

mobile_machineDlg=True 

Select  Case  action% 
Case  1 

'  initialize  stuff 
s_bIsmobile_MachineUp=True 

Case  2 

'   control  event 
Select  Case  controlname$ 
Case  "ok" 

auto_f lag= "mobile " 

auto_machine=DlgText$ ( "mobile_number " ) 
Dim  mobile_target  as  String 
mobile_target=DlgText$ ( "target_name" ) 
Dim  tl  as  MobileCrane 


Set  tl=GetMobileCrane {auto_machine) 
tl . GoingTo=mobile_target 
Dim  jobl  as  Script 
Set 

jobl=GetScript ( "mobile_going_to_targetscript" ) 

tl.AddTask  jobl 
Set  tl.Job=jobl 
auto_tnode=True 
mobile_machineDlg=False 
Case  "cancel" 

mobile_machineDlg=False 

MsgBox  "No  machine  was  selected  for 

autonomous  mode ..." 

End  Select 

case  3 

'  content  of  text/combo  box  changed 

case  4 

'  control  gains  focus 

case  5 

'  idle  message 

case  6 

'  dialog  box  has  been  moved 

End  Select 
End  Function 

Begin  Dialog  mobile_machine_targetdlg  ,, 127 , 81 , "Autonomous 
Mode", .mobile_machinedlg 

OKButton  8,60,40,14, .ok 

CancelButton  76 , 60 , 40 , 14 , . cancel 

Text  8, 8, 72, 8, "Mobile  Crane  number :",. Text 2 

TextBox  84 , 8 , 36 , 12 , .mobile_number 

Text  8, 24, 104, 8, "Going  to  target :",. Text3 

TextBox  12,36,100,12, .target_name 
End  Dialog 

Public  Fxmction  excv_machineDlg (controlname$,  action%,  suppvalue%) 
Integer 

excv_machineDlg=true 

Select  Case  action% 
Case  1 

'   initialize  stuff 
s_bIsexcv_MachineUp=True 

Case  2 

'  control  event 
Select  Case  controlname$ 
Case  "ok" 

auto_f lag= " excv " 

auto_machine=DlgText$ ( " excv_number " ) 
Dim  excv_target  as  String 
excv_target=DlgText$ ( " targe t_name" ) 
Dim  t2  as  Excavator 
set  t2=GetExcavator (auto  machine) 
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t2 .GoingTo=excv_target 
Dim  job2  as  Script 
Set 

job2=GetScript { "excv_going_to_targetscript" ) 

t2.AddTask  job2 
Set  t2.job=job2 
auto_mode=True 
excv_machineDlg=False 
Case  "cancel" 

excv_machineDlg=False 

MsgBox  "No  machine  was  selected  for 

autonomous  mode ..." 

End  Select 

case  3 

'  content  of  text /combo  box  changed 

case  4 

'   control  gains  focus 

case  5 

'   idle  message 

case  6 

'  dialog  box  has  been  moved 

End  Select 
End  Function 

Begin  Dialog  excv_machine_targetdlg  ,,  116 , 81 , "Autonomous 
Mode " , . excv_machinedlg 

OKButton  8, 60,40, 14, .ok 

CancelButton  68 , 60 , 40, 14 ,. cancel 

Text  8, 8, 60, 8, "Excavator  number Text2 

TextBox  72 , 8 , 36 , 12 , . excv_number 

Text  8, 24, 104, 8, "Going  to  target :", .Text3 

TextBox  8, 36, 100, 12, . targe t_name 
End  Dialog 


Public  Function  tower_machineDlg (controlname$ ,  action%,  suppvalue%)  As 
Integer 

tower_machineDlg=True 

Select  Case  action% 
Case  1 

'  initialize  stuff 
s_bIstower_MachineUp=True 

Case  2 

'  control  event 
Select  Case  controlname$ 
Case  "ok" 

auto_flag=" tower" 

auto_machine  =  DlgText$ ( "tower_number" ) 
Dim  tower_target  as  String 
tower_target=DlgText$ ( "target_name" ) 
Dim  t3  as  TowerCrane 


Set  t3=GetTowerCrane (auto_machine) 
t3 .GoingTo=tower_target 
Dim  jobs  as  Script 
Set 

job3=GetScript ( "tower_going_to_targetscript" ) 

tS.AddTask  job3 
Set  t3.Job=job3 
auto_mode=True 
tower_machineDlg=False 
Case  "cancel" 

tower_machineDlg=False 

MsgBox  "No  machine  was  selected  for 

autonomous  mode ..." 

End  Select 

case  3 

'  content  of  text/combo  box  changed 

case  4 

'  control  gains  focus 

case  5 

'   idle  message 

case  6 

'  dialog  box  has  been  moved 

End  Select 
End  Function 

Begin  Dialog  tower_machine_targetdlg  ,, 13  0, 81, "Autonomous 
Mode" , . tower_machinedlg 

OKButton  8, 60,40, 14, .ok 

CancelButton  80,60,40,14, . cancel 

Text  8, 8, 68, 8, "Tower  Crane  number :",. Text 2 

TextBox  84 , 8 , 36 , 12 , . tower_number 

Text  8,24,104,8, "Going  to  target :",. Text3 

TextBox  8,36, 112 , 12 , . target_name 
End  Dialog 

Sub  MainO 

Dim  a$ (5) 

a$ (1) = "Truck" 

a$ (2) ="Mobile  Crane" 

a$ { 3 ) = " Tower  Crane " 

a$ (4) = "Excavator" 

result%  =  SelectBox { "Autonomous  Mode  Machine  Control ...", "Pi 
select  Machine  Type:",a$) 

Select  Case  result% 
Case  1 

MsgBox  "You  have  selected:   "  &  a$ (result%) 
Dim  panel  as  truck_machine_targetdlg 
Dialog  panel 

Case  2 

MsgBox  "You  have  selected:   "  &  a$(result%) 
Dim  panel2  as  mobile_machine_targetdlg 


Dialog  panel2 

Case  3 

MsgBox  "You  have  selected:   "  &  a$ (result%) 
Dim  panel 3  as  tower_machine_targetdlg 
Dialog  panel3 

Case  4 

MsgBox  "You  have  selected:   "  &  a$(result%) 
Dim  panel4  as  excv_machine_targetdlg 
Dialog  panel4 

Case  5 
End  Select 

End  Sub 


'  This  Task_Module  is  for  dragging  objects  in  SIMCON's  GUI 

Public  DraggedObject  as  Geometry 
Public  DraggedlnitalPoint  as  Vect3d 
Public  MouseDown  as  Boolean 
Public  dragging  as  Boolean 

Sub  Task (  ob j  as  Root  ) 

If  not  dragging  Then 
Exit  Sub 

End  If 

Dim  m  as  Mouse 
Set  m=GetFirstMouse 
Dim  screenpt  as  Vect2d 
m.GetPosition  screenpt 

If  m.MiscData=Lef tHeld  Then 
If  not  MouseDown  Then 
MouseDown=True 

Set  DraggedObject=PickGeometry {  screenpt  ) 
If  not {  DraggedObject  is  nothing  )  Then 
Dim  ThrowAwayOri  as  Orientation 
DraggedOb j  ect . GetGlobalLocation 
DraggedlnitalPoint,  ThrowAwayOri 

End  If 

End  If 
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Else 

If  MouseDown  Then 

MouseDovm=False 

Set  DraggedObject=nothing 

End  If 

End  If 


If  m.MiscData=Lef tHeld  and  not (  DraggedObject  is  nothing  )  Then 

'  Get  the  orientation  of  viewpoint .     This  will  be  the 

'  normal  of  the  projection  plane 

Dim  viewpt  as  Viewpoint 

Set  viewpt=GetViewpoint ( "Viewpoint - 1 " ) 

Dim  normal  as  Orientation 

viewpt .GetOrientat ion  normal 

Dim  newpos  as  Vect3d 
Dim  dist  as  Integer 

PickPlane  screenpt,  DraggedlnitalPoint,  normal,  newpos, 

dist 

'Set  the  new  global  position  {must  first  get  the  current 

' location  to  keep  the  same  global  orientation) 

Dim  rot  as  Orientation 

Dim  ThrowAwayVect  as  Vect3d 

DraggedObject .GetGlobalLocation  ThrowAwayVect,  rot 
DraggedObject . SetGlobalLocation  newpos,  rot 

End  If 


End  Sub 


'This  Module  is  to  let  the  user  adding 
'a  building  component  from  a  file  using 
'an  open  dialog  box 

Public  s_bIsBcUp  as  Boolean 

Public  Function  bcDlg (controlname$ ,  action%,  suppvalue%)  As  Integer 
bcDlg=True 
Select  Case  action% 
Case  1 

'   initialize  stuff 
s_bIsBcUp=True 

Case  2 

'  control  event 
Select  Case  controlname$ 
Case  "add_bc" 

call  add_building_component 

Case  "done" 

bcDlg=False 

End  Select 

case  3 
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'  content  of  text/combo  box  changed 

case  4 

'   control  gains  focus 

case  5 

'   idle  message 

case  6 

'  dialog  box  has  been  moved 

End  Select 
End  Function 

Begin  Dialog  bcDialog  ,, 248 , 121, "Add  Building  Component ",. bcDlg 
TextBox  72, 32, 36, 12, .x_location 
TextBox  72 , 72 , 36 , 12 , . 2_location 
Text  20,32,36,8, "X-location" , .Textl 
Text  20,52,36,8, "Y-location" , .Text2 

GroupBox  12 , 12 , 108 , 80 , "Building  Component  Location" , .GroupBoxl 

PushButton  132,100,104,14, "Done", .done 

Text  136 , 28 , 52, 8, "Component  ID",.Text6 

TextBox  136, 40, 88, 12, .bc_id 

Text  136,60,48,8, "Building  ID",.Text7 

TextBox  136,72,88,12, .building_id 

GroupBox  128 , 12 , 108 , 80 , "Building  Component  Info . " , . GroupBox3 
Text  2  0, 72,44,8, "Z-  location" ,. Text8 
TextBox  72 , 52 , 36 , 12 , . y_location 

PushButton  12, 100, 108, 14, "Add  Building  Component ",. add_bc 
End  Dialog 
Sub  Main  () 

Dim  panel  as  bcDialog 

Dialog  panel 
End  Sub 

Sub  add_building_component 
Dim  pos  as  Vect3d 
pos . x=val (DlgText$ { "x_location" ) ) 
pos .y=val (DlgText$ { "y_location" ) ) 
pos . z=val (DlgText$ { "z_location" ) ) 
Dim  b  as  New  be 

b . Filename=OpenFilename$ { "Building  Component " , " 3ds 
Models :*. 3ds ,*. nff " ) 

Dim  result  as  Boolean  , 

Dim  c  as  String 

Dim  building  as  String 

building= "building- " +DlgText$ ( "building_id" ) 
c  =  DlgText$ ( "bc_id" ) 
result=b. Construct (c) 
b. SetTranslation  pos 
Dim  k  as  Building 
Set  k=GetBuilding (building) 
k.AddChild  b 
End  Sub 
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'This  Task_Module  is  to  detect  a  collision  between 
'Mobile  Crane  Boom  and  a  building  component 

Public  which_machine  as  String 
Sub  Task  (m  as  graber) 

Dim  iter  as  Iterator 

Dim  obj  as  BC 

set  obj =GetFirstBC (iter) 

While  obj  is  not  Nothing 

If  m. IntersectsMovable (obj )  Then 

message  "Mobile  Crane  is  bumping  with  "  +  obj .name 

End  If 

Set  obj =GetNextBC{ iter) 

Wend 
End  Sub 


' This  Module  is  to  let  the  user  to  add 

'difinition  of  a  Building  in  the  virtual  environment 

Public  s_bIsBuildingUp  as  Boolean 

Public  Function  buildingDlg (controlname$ ,  action%,  suppvalue%)  As 
Integer 

buildingDlg=True 

Select  Case  action% 
Case  1 

'   initialize  stuff 
s_bIsBuildingUp  =  TRUE 

Case  2 

'  control  event 
Select  Case  controlname$ 
Case  "addbuild" 

Dim  b  as  new  Building 
Dim  result  as  Boolean 

Dim  c  as  String 

c= "building- " +DlgText$ ( "build_id" ) 
result=b. Construct (c) 
Dim  k  as  Root 
Set  k=GetRoot ("root-1") 
k.AddChild  b 
Case  "done" 

buildingDlg=False 

End  Select 

Case  3 

'   content  of  text /combo  box  changed 

Case  4 

'  control  gains  focus 

Case  5 
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'  idle  message 

Case  6 

'  dialog  box  has  been  moved 

End  Select 
End  Fianction 

Begin  Dialog  buildDialog      108 , 88 , "Building  Construction" , .buildingDlg 

PushButton  16,48,76,16, "Add  Building" , .addbuild 

Text  12,12,44,8, "Building  ID",.Text3 

TextBox  12, 28, 84 , 12 , .build_id 

PushButton  16, 68, 76, 14 , "Done" , .done 
End  Dialog 

Sub  Main  {) 

Dim  panel  as  buildDialog 

Dialog  panel 
End  Sub 


'This  is  the  main  Excavator  equipment  control  Module 

Public  accel  as  Single 
Public  visual  as  Boolean 

Sub  Task  (m  as  Excavator) 

Dim  f  as  SerialJoystick 

Set  f =GetSerialJoystick ( "Serial  Joystick-1") 

Dim  eng  as  Sound 

Set  eng=GetSound("Sound-3") 

Dim  e2  as  Sound 

Set  e2=GetSound("Sound-2") 

Dim  e3  as  Sound 

Set  e3=GetSound( "Sound-4") 

Dim  flag  as  Boolean 

Dim  r  as  Root 

Set  r=GetRoot ("Root-1") 

Dim  mater  as  Material 
Dim  mater_s  as  Script 
Set  mater_s=GetScript ( "sandscript" ) 

Dim  mater_pos  as  Vect3d 

Dim  mater_ori  as  Orientation 

Set  mater=GetMaterial ( " sand- 1 " ) 

mater .GetTranslation  mater_pos 

mater .GetRotation  mater_ori 

Dim  v  as  Viewpoint 

Set  v=GetViewpoint ( " viewpoint - 1 " ) 


'  Getting  handle  for  Truck  Tires 
Dim  t (2)   as  Tire 

Set  t (1) =GetTire ("lef t-excv-tire" ) 
Set  t ( 2 ) =GetTire ( " right - excv- t ire " ) 

'  Getting  handle  for  Truck  Control  parts 

Set  m=GetExcavator { "excavator- 1" ) 

Dim  b  as  Machine 

Set  b=GetMachine ( "excv-body" ) 

Dim  a (3)   as  Machine 

Dim  hand_pos  as  Vect3d 

Set  a  ( 1)  =GetMachine  ( "  excv- ami " ) 

Set  a (2) =GetMachine ( "excv-arm2 " ) 

Set  a(3) =GetMachine ( "excv-hand" ) 

a (3) .GetTranslation  hand_pos 

hand_pos .x=handjpos .x+100 

hand_pos .  y=hand_j)os .  y+100 

Dim  kb  as  Keyboard 

Set  kb=GetKeyboard ( "Keyboardlnput" ) 

If  kb.Key  ="k"  Then 

If  vi sua 1= True  Then 

call  right_move 

Else 

m.Yaw  5 

m . Heading=m . Heading+  5 

End  If 
Elself  kb.Key  ="j"  Then 

If  visual=true  Then 
call  left_move 

Else 

m . yaw  -  5 

m . Heading=m . Heading- 5 

End  If 

Elself  kb.Key  =  "i"  Then 

m.Acceleration=m. Acceleration  +  5 
Elself  kb.Key="m"  Then 

m. Acceleration  =  m. Acceleration  -  5 
Elself  kb.Key="p"  Then 

If  visual =True  Then 

call  right_body_move 

Else 

b.Yaw  5 

End  If 
Elself  kb.Key="o"  Then 

If  visual=True  Then 

call  lef t_body_move 

Else 

b.Yaw  -5 

End  If 
Elself  kb.Key="0"  Then 

a (1) . Pitchparent  2 
a (2) . Pitchparent  2 


Elseif  kb.Key  ="1"  Then 

a{l) .Pitchparent  -2 
a (2) . Pitchparent  -2 

Elself  kb.Key="q"  Then 

a (2) .Pitchparent  2 

Elself  kb.Key="w"  Then 

a (2) .Pitchparent  -2 

Elself  kb.Key="a"  Then 

a (3) .Pitchparent  5 

Elseif  kb.Key="s"  Then 

a (3) .Pitchparent  -5 

Elself  k;b.Key="g"  Then 

r .RemoveChild  mater 
a (3) .AddChild  mater 

Elself  kb.Key="r"  Then 

a (3) .RemoveChild  mater 
mater .AddTask  mater_s 

Elself  kb.Key=  "s"  Then 
eng . Playing=True 

End  If 


If  f .MiscData  and  SERJOY_HATUP  Then 

a (1) . Pitchparent  2 

a (2) .Pitchparent  2 
Elself  f .MiscData  and  SERJOY_HATDOWN  Then 

a (1) . Pitchparent  -2 

a (2) .Pitchparent  -2 
Elself  f .MiscData  and  SERJOY_HATRIGHT  Then 

If  visual=True  Then 

call  right_body_move 

Else 

b.Yaw  5 

End  If 

Elself  f. MiscData  and  SERJOY_HATLEFT  Then 
If  visual=True  Then 

call  lef t_body_move 

Else 

b.Yaw  -5 

End  If 

Elself  f .MiscData  and  SERJOY_TRIGGERDOWN  Then 
m.Acceleration=m. Acceleration  +  5 
f . Sensitivity=m. Acceleration 

Elself  f. MiscData  and  SERJOY_SIDEDOWN  Then 
m.Acceleration=m. Acceleration  -  5 
f . Sensitivity=m. Acceleration 

End  If 

Dim  accel  as  Single 
accel=m. Acceleration 
m. Translate  0,0, accel 


Select  Case  m. Acceleration 
Case  is=0 

■EXCAVATOR  STOPPED 
Case  is>0 

Message  "excavator  is  moving  forward" 
Case  is<0 

Message  "excavator  is  moving  backward" 

End  Select 
End  Sub 

Sub  right_move 

Dim  m  as  Excavator 

Set  m=GetExcavator ( "excavator- 1" ) 

Dim  V  as  Viewpoint 

Set  v=GetViewpoint ( "viewpoint-1" ) 

V. Rotate  y_axis, (5*PI/180) 

m.Yaw  5 

m . Heading=m . Heading+5 
End  Sub 

Sub  left_move 

Dim  m  as  Excavator 

Set  m=GetExcavator ( " excavator- 1" ) 

Dim  V  as  Viewpoint 

Set  v=GetViewpoint ("viewpoint-1") 

V. Rotate  y_axis, - (5*PI/180) 

m.Yaw  -5 

m . Heading=m . Heading - 5 
End  Sub 

Sub  right_body_move 

Dim  b  as  Machine 

Set  b=GetMachine ( "excv-body" ) 

Dim  V  as  Viewpoint 

Set  v=GetViewpoint ( "viewpoint-1" ) 

V. Rotate  y_axis, (5*PI/180) 

b.Yaw  5 
End  Sub 

Sub  lef t_body_move 

Dim  b  as  Machine 

Set  b=GetMachine ( "excv-body" ) 

Dim  V  as  Viewpoint 

Set  v=GetViewpoint ( "viewpoint-1" ) 

V. Rotate  y_axis, - (5*PI/180) 

b.Yaw  -5 
End  Sub 


'This  Task_Module  is  to  let  the  Excavator  equipment 
'detects  the  location  of  the  target  object 
'so  it  can  adjust  its  orientation  to  it 
Siib  Task  (t  as  Excavator) 

Dim  job  as  Script 

Set  job=GetScript { "excv_going_to_targetscript" ) 
Dim  job2  as  Script 

Set  job2=GetScript ( "excv_move_awayscript" ) 

Dim  tr  as  Tree 

Set  tr=GetTree("tree-l") 

Dim  bldng  as  Building 

Set  bldng=GetBuilding ( "building- 1" ) 

Dim  m  as  Material 

Set  m=GetMater ial { t . goingto ) 

Dim  t_o  as  Orientation 

Dim  tpos  as  Vect3d 

Dim  mo  as  Orientation 

Dim  mpos  as  Vect3d 

t .GetTranslation  tpos 

m.GetTranslation  mpos 

Dim  diff  as  Vect3d 

Vect3dSubtract  mpos, tpos, diff 

DirToOrient  diff,t_o 

t_o.x=0 

t_o. z=0 

t . SetRotation  t_o 

t. Translate  0,0,10 

If  t . IntersectsMovable (tr)  Then 

MsgBox  "excavator  is  bumping  into  a  tree, 

MsgBox  "trying  to  find  it's  new  path..." 

t .  RemoveTask  j  ob 

t.AddTask  job2 

Set  t.Job=job2 

End  If 

If  t . IntersectsMovable (bldng)  Then 

MsgBox  "truck  is  bumping  into  a  building, 
MsgBox  "trying  to  find  it's  new  path..." 
t . RemoveTask  j  ob 
t.AddTask  job2 
Set  t.Job=job2 

End  If 

If  t . IntersectsMovable (m)  Then 

MsgBox  "excavator  reached  target. . . " 
t . RemoveTask  j  ob 

End  If 
End  Sub 


'This  Task_Module  is  to  make  the  Excavator  equipment 
'move  away  from  the  obstacle 

Public  auto_flag  as  String 
Public  auto_machine  as  String 
Public  excv_target  as  String 

Sub  Task  (t  as  Excavator) 

Set  t=GetExcavator (auto_machine) 
Dim  job  as  Script 

Set  job=GetScript ( "excv_move_awayscript" ) 
Dim  job2  as  Script 

Set  job2=GetScript ( "excv_rotate_f romscript" ) 
t. Translate  0,0,-50 
t . RemoveTask  j  ob 
t.AddTask  job2 
Set  t.Job=job2 
End  Sub 


' This  Task_Module  is  to  make  the  Excavator  equipment 
'move  far  enough  from  the  obstacle 
Public  auto_flag  as  String 
Public  auto_machine  as  String 
Public  excv_target  as  String 

Sub  Task(t  as  Excavator) 

Set  t=GetExcavator (auto_machine) 
Dim  job  as  Script 

Set  job=GetScript ( "excv_move_f arscript" ) 
Dim  job2  as  Script 

Set  job2=GetScript ( "excv_going_to_targetscript" ) 
t. Translate  0,0,300 
t . RemoveTask  j  ob 
t.AddTask  job2 
Set  t.Job=job2 

End  Sub 


'This  Task_Module  is  to  make  the  Excavator  equipment 
'rotate  90  degrees  to  adjust  its  motion  vector 
Public  auto_flag  as  String 
Public  auto_machine  as  String 
Public  excv_target  as  String 

Sub  excv_rotate_f rom 

Dim  t  as  Excavator 

Set  t=GetExcavator (auto_machine) 

Dim  job  as  Script 

Set  job=GetScript ( "excv_rotate_f romscript" ) 
Dim  job2  as  Script 

Set  job2=GetScript ("excv_move_farscript") 
t. Rotate  y_axis,  90 
t . RemoveTask  j  ob 
t.AddTask  job2 
Set  t.Job=job2 
End  Sub 


'Excavator  terrain- following  Task_Module 

'A  Terrain  Following  Algorithm  for  the  Excavator  equipment 

Sub  Task (m  as  Excavator) 

Dim  debug  as  Boolean 
debug=False 

Dim  distance (4)  as  Single 
Dim  tx(4)   as  Vect3d 
Dim  startnode  as  Node 
Dim  p2  as  Vect3d 
Dim  poly (4)   as  Long 
Dim  foundgeom(4)  as  Boolean 
Dim  geom  as  Geometry 
Dim  height  as  Single 
Dim  tdim  as  Vect3d 
Dim  tmid  as  Vect3d 
Dim  tpos  as  Vect3d 
Dim  sum  as  SingLE 
Dim  num  as  Single 
Dim  pitch  as  Single 
Dim  roll  as  Single 
Dim  q  as  Orientation 
Dim  ori  as  Orientation 
Dim  dir  as  Vect3d 

'  Get  Excavator ' s  position  and  geometry  information 
m.GetTranslation  tpos 
m.GetMidpoint  tmid 
m.GetDimensions  tdim 
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Save  Excavator ' s  corner  points  in  xz  plane 
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Set  startnode=GetNode ( "Root - 1 " ) 

'  Initialize  direction  vector  for  rayintersect 
p2.X=0.0 

p2.Y=1.0 
p2.Z=0.0 
num=0 . 0 
For  i=l  to  4 

tx{i) .y=tx(i) .y-m. Radius 

poly (i) =RayIntersect (startnode,   tx(i),  p2,  geom,  height) 
'  if  rayinterect  found  a  geometry  below,  record/ sum 

heights,  and 

'  the  fact  that  we  found  a  geometry  for  this  corner 
If  geom  is  not  nothing  Then 

distance (i) =height 

sum=sum+distance (i) 

f oundgeom ( i ) =True 

num=num+l 

End  If 

Next  i 

'Use  the  average  of  the  heights  for  the  height  of  the  Excavator 

If  num>0.0  Then  height=sum/num 

'  Move  Excavator  closer  to  terrain 

If   (height  >0)  Then 

m. Translate  0, height -m. radius- (tdim. y  /  2.25),0 

End  If 

'  pitch  and  roll  object  accordingly 

If  (f oiindgeom (1)  and  f oundgeom (2)   and  f oundgeom (3))  Then 
pitch=atn ( (distance (2) -distance (1) ) /tdim. z) 
roll=atn( (distance (1) -distance (3) ) /tdim.x) 
orientset  q, pitch*180 . 0/pi , m. heading, roll*180 . 0/pi 
m. SetRotation  q 

End  If 
End  Sub 


' This  Task_Module  is  to  add  a  patch  of  material 
'by  the  user 

Sub  Main  () 

Dim  mater  as  new  Material 

Dim  result  as  Boolean 

Dim  material_id  as  String 

material_id= " sand- 1 " 

result=mater . Construct { "sand-1" ) 

Dim  r  as  Root 

Set  r=GetRoot("root-l") 

r.AddChild  mater 
End  Sub 


'Main  Task_Module  for  the  Mobile  Crane  equipment 

'in  SIMCON's  GUI 

Public  which_machine  as  String 

Public  accel  as  Single 

Public  visual  as  Boolean 

Sub  Task   (m  as  MobileCrane) 

Dim  m_pos  as  Vect3d 
m.GetTranslation  m_pos 
Dim  g  as  Graber 

Set  g=GetGraber ( "m-crane-graber" ) 

Dim  iter  as  Iterator 

Dim  obj  as  BC 

Set  obj =GetFirstBC (iter) 

Dim  f  as  SerialJoystick 

Set  f =GetSerialJoystick ( "Serial  Joystick-1") 

Dim  eng  as  Sound 

Set  eng=GetSound("Sound-3") 

Dim  e2  as  Sound 

Set  e2=GetSound("Sound-2") 

Dim  e3  as  Sound 

Set  e3=GetSound("Sound-4") 

Dim  e4  as  Sound 

Set  e4=GetSound("Sound-5") 

'  Getting  handle  for  Mobile  Crane  Tires 
Dim  t (4)   as  Tire 

Set  t (1) =GetTire( "front-left-mobile-tire") 
Set  t (2) =GetTire { "front-right-mobile- tire" ) 
Set  t (3) =GetTire ("back-left-mobile-tire") 
Set  t (4) =GetTire ("back-right-mobile-tire") 

'  Getting  handle  for  Mobile  Control  parts 
Set  m=GetMobileCrane ( "MobileCrane-1" ) 
Dim  d  as  Machine 

Set  d=GetMachine ( "m- crane -driver" ) 
Dim  r(4)   as  Machine 


Set  r (1) =GetMachine ( " m- crane -booml" ) 
Set  r (2) =GetMachine ( "m-crane-boom2 " ) 
Set  r (3) =GetMachine ( "m-crane-boom3 " ) 
Set  r (4) =GetMachine ( "m- crane -boom4 " ) 
Set  g=GetGraber ( "m- crane -graber" ) 

Dim  pos  as  VectBd 

Dim  kb  as  Keyboard 

Set  kb=GetKeyboard ( " Keyboardlnput " ) 

If  kb.Key="k"  Then 

If  visual=True  Then 

call  right_move 

Else 

m.Yaw  5 

m . Heading=m . Heading+5 

End  If 

Elself  kb.Key="j"  Then 

If  visual =True  Then 
call  left_move 

Else 

m . Yaw  - 5 

m . Heading=m . Heading - 5 

End  If 
Elself  kb.Key="i"  Then 

m . Acceleration=m . Accelerat ion+5 
Elself  kb.Key="m"  Then 

m. Accelerat ion=m. Accelerat ion- 5 
Elself  kb.Key="p"  Then 

If  visual=True  Then 

call  right_driver_move 

Else 

d.Yaw  5 

End  If 
Elself  kb.Key="o"  Then 

If  visual=True  Then 

call  lef t_driver_move 

Else 

d.Yaw  -5 

End  If 
Elself  kb.Key="s"  Then 

eng . Playing=True 
Elself  kb.Key="0"  Then 

r  (1)  . PitchParent  2 

g. Pitch  -2 
Elself  kb.Key="l"  Then 

r(l) .PitchParent  -2 

g. Pitch  2 
Elself  kb.Key="q"  Then 

pos .x=0 

pos .y=0 

pos . z=10 


r (2) .Translate  pos 
Elself  kb.Key="w"  Then 

pos .x=0 

pos .y=0 

pos . z=-10 

r(2) .Translate  pos 
Elself  kb.Key="e"  Then 

pos .x=0 

pos .y=0 

pos . z=10 

r (3) .Translate  pos 
Elself  kb.Key="r"  Then 

pos .x=0 

pos .y=0 

pos. z=-10 

r (3) .Translate  pos 
Elself  kb.Key="t"  Then 

pos .x=0 

pos .y=0 

pos . 2=10 

r(4) .Translate  pos 
Elself  kb.Key="y"  Then 

pos .x=0 

pos .y=0 

pos . z=-10 

r(4) .Translate  pos 
Elself  kb.Key="c"  Then 

pos .x=0 

pos .y=10 

pos . z=0 

g. Translate  pos 
Elself  kb.Key="v"  Then 
pos .x=0 
pos .y=-10 
pos . z=0 

g.TreUislate  pos 

End  If 


If  f.MiscData  and  SERJOY_HATUP  Then 
r(l) .PitchParent  -2 
g. Pitch  2 

Elself  f.MiscData  and  SERJOY_HATDOWN  Then 
r (1) . PitchParent  2 
g. Pitch  -2 

Elself  f.MiscData  and  SERJOY_HATRIGHT  Then 
If  visual=True  Then 

call  right_driver_move 

Else 

d.Yaw  5 

End  If 

Elself  f.MiscData  and  SERJOY  HATLEFT  Then 
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If  visual=True  Then 

call  right_driver_move 

Else 

d.Yaw  -5 

End  If 

Elself  f .MiscData  and  SERJOY_TRIGGERDOWN  Then 

m . Acceleration=m . Acceleration+5 

f . Sensitivity=m. Acceleration 
Elself  f .MiscData  and  SERJOy_SIDEDOWN  Then 

m . Acceleration=m . Acceleration- 5 

f . Sensitivity=m. Acceleration 

End  If 

Dim  accel  as  Single 
accel=m . Acceleration 
m. Translate  0,0, accel 
While  obj  is  not  nothing 

If  g. IntersectsMovable (obj )  Then 

message  "Mobile  Crane  is  bumping  with  "+  obj .name 

m_pos . z=m_pos . z-1 

End  If 

Set  obj =GetNextBC (iter) 

Wend 


Dim  rot  as  Single 
rot=ABS (accel) 

Select  Case  accel 
Case  is=0 

'message  "truck  stopped" 
e2 . Playing=False 
e2 . Repeat=False 
e4 . Playing=False 
e4 . Repeat=False 
Case  is>0 

For  i=l  to  4 

t (i) .Pitch  -rot 
e2 . Playing=True 
e2 .Repeat=True 

Next  i 
Case  is<0 

For  i=l  to  4 

t (i) .Pitch  rot 
■ e2 . Playing=True 
' e2 . Repeat=True 
e4 . Playing=True 
e4 . Repeat=True 

Next  i 

End  Select 


End  Svib 


Sub  rightmove 

Dim  V  as  Viewpoint 

Set  v=GetViewpoint ( "machine_view" ) 

Dim  m  as  MobileCrane 

Dim  m_pos  as  Vect3d 

Dim  m_ori  as  Orientation 

Set  m=GetMobileCrane (which_machine) 

m.GetTranslation  m_pos 

m.GetRotation  m_ori 

m.Yaw  5 

m . Heading=m . Heading+5 
V. SetPosition  m_pos 
V. Rotate  y_axis,  5 
End  Sub 

Sub  left_move 

Dim  V  as  Viewpoint 

Set  v=GetViewpoint ( "machine_view" ) 

Dim  m  as  MobileCrane 

Dim  m_pos  as  Vect3d 

Dim  m_ori  as  Orientation 

Set  m=GetMobileCrane (which_machine) 

m.GetTranslation  m_pos 

m.GetRotation  m_ori 

m.Yaw  -5 

m . Heading=m . Heading- 5 
V. SetPosition  m_pos 
V. Rotate  y_axis,  -5 
End  Sub 

Sub  right_driver_move 

Dim  V  as  Viewpoint 

Set  v=GetViewpoint ( "machine_view" ) 

Dim  m  as  Machine 

Dim  m_pos  as  Vect3d 

Dim  m_ori  as  Orientation 

Set  m=GetMachine ( "m-crane-driver " ) 

m.GetTranslation  m_j)os 

m.GetRotation  m_ori 

m.yaw  5 

V. SetPosition  m_pos 
V. Rotate  y_axis,  5 
End  Svib 

Sub  lef t_driver_move 

Dim  V  as  Viewpoint 

Set  v=GetViewpoint ( "machine_view" ) 

Dim  m  as  Machine 

Dim  m_pos  as  Vect3d 

Dim  m  ori  as  Orientation 


Set  m=GetMachine ( "m-crane-driver" ) 
m.GetTranslation  m_pos 
m . yaw  - 5 

V. SetPosition  m^pos 
V. Rotate  y_axis,  -5 
End  Sub 


'This  Task_Module  is  to  let  the  Mobile  Crane 
' equipment  detects  the  location  of  the  target 
'object  so  it  can  adjust  its  orientation  to  it 
Sub  Task  (t  as  MobileCrane) 
Dim  job  as  Script 

Set  job=GetScript ( "mobile_going_to_targetscript" ) 
Dim  job2  as  Script 

Set  job2=GetScript ( "mobile_move_awayscript" ) 

Dim  tr  as  Tree 

Set  tr=GetTree{"tree-l") 

Dim  bldng  as  Building 

Set  bldng=GetBuilding ( "building- 1 " ) 

Dim  m  as  Material 

Set  m=GetMaterial (t .goingto) 

Dim  t_o  as  Orientation 
Dim  tpos  as  Vect3d 
Dim  mo  as  Orientation 
Dim  mpos  as  Vect3d 

t .gettranslation  tpos 
m.gettranslation  mpos 

Dim  diff  as  Vect3d 
VectSdSubtract  mpos, tpos, diff 
DirToOrient  diff,t_o 

t_o.x=0 
t_o. z=0 

t . SetRotation  t_o 
t. Translate  0,0,10 

Dim  ti (4)  as  Tire 

Set  ti (1) =GetTire ("front-left-mobile-tire") 

Set  ti (2) =GetTire ("front-right-mobile-tire") 

Set  ti (3) =GetTire ("back-left-mobile-tire") 

Set  ti (4) =GetTire ("back-right-mobile-tire") 


For  i=l  to  4 

ti (i) .Pitch  -20 

Next  I 

If  t . IntersectsMovable (tr)  Then 

MsgBox  "mobile  is  bumping  into  a  tree, " 
MsgBox  "trying  to  find  it's  new  path..." 
t . RemoveTask  j  ob 
t.AddTask  job2 
Set  t.Job=job2 

End  If 

If  t. IntersectsMovable (bldng)  Then 

MsgBox  "truck  is  bumping  into  a  building, " 
MsgBox  "trying  to  find  it's  new  path..." 
t . RemoveTask  j  ob 
t.AddTask  job2 
Set  t.Job=job2 

End  If 

If  t . IntersectsMovable (m)  Then 

MsgBox  "mobile  reached  target ..." 
t . RemoveTask  j  ob 

End  If 
End  Svib 


'This  Task_Module  is  to  make  the  Mobile  Crane  equipment 

'move  away  from  the  obstacle 

Piablic  auto_flag  as  string 

Public  auto_machine  as  string 

Public  mobile_target  as  string 

Sub  Task(t  as  MobileCrane) 

Set  t=GetMobileCrane {auto_machine) 

Dim  job  as  Script 

Set  job=GetScript ( "mobile_move_awayscript" ) 
Dim  job2  as  Script 

Set  job2=GetScript ( "mobile_rotate_f romscript" ) 
t. Translate  0,0,-50 
t. RemoveTask  job 
t.AddTask  job2 
Set  t.Job=job2 
End  Sub 


'This  Task_Module  is  to  make  the  Mobile  Crane  equipment 

'move  far  enough  from  the  obstacle 

Public  auto_flag  as  String 

Public  auto_machine  as  String 

Public  mobile_target  as  String 

Sub  Task(t  as  MobileCrane) 

Set  t=getmobilecrane (auto_machine) 

Dim  job  as  Script 

Set  j  ob=GetScript ( "mobile_move_f arscript " ) 
Dim  job2  as  Script 

Set  job2=GetScript ( "mobile_going_to_targetscript" ) 
t. Translate  0,0,300 
t . RemoveTask  j  ob 
t.AddTask  job2 
Set  t.Job=job2 
End  Sub 


'This  Task_Module  is  to  make  the  Mobile  Crane  equipment 
'rotate  90  degrees  to  adjust  its  motion  vector 
Public  auto_flag  as  String 
Public  auto_machine  as  String 
Public  mobile_target  as  String 
Sub  Task(t  as  MobileCrane) 

Set  t=getmobilecrane (auto_machine) 

Dim  job  as  Script 

Set  job=GetScript { "mobile_rotate_f romscript" ) 
Dim  job2  as  Script 

Set  job2=GetScript ( "mobile_move_f arscript" ) 
t. Rotate  y_axis,  90 
t. RemoveTask  job 
t.AddTask  job2 
Set  t.Job=job2 
End  Sub 


'Mobile  Crane  terrain- following  Task_Module 

'A  Terrain  Following  Algorithm  for  the  Mobile  Crane  equipment 

Sub  Task(m  as  MobileCrane) 
Dim  debug  as  Boolean 
debug=False 

Dim  distance (4)   as  Single 
Dim  tx(4)  as  Vect3d 
Dim  startnode  as  Node 
Dim  p2  as  Vect3d 
Dim  poly (4)   as  Long 
Dim  foundgeom(4)  as  Boolean 
Dim  geom  as  Geometry- 
Dim  height  as  Single 
Dim  tdim  as  Vect3d 
Dim  tmid  as  VectSd 
Dim  tpos  as  Vect3d 
Dim  sum  as  Single 
Dim  num  as  Single 
Dim  pitch  as  Single 
Dim  roll  as  Single 
Dim  q  as  Orientation 
Dim  ori  as  Orientation 
Dim  dir  as  VectSd 
Dim  head  as  Single 

'  Get  MobileCrane ' s  orientation 
'm.GetRotation  ori 
'message  ori.y*180/pi 
'OrientToDir  ori, dir 
'dir .y=0 

'DirToOrient  dir, ori 
'VectSdNorm  dir 
' head=ATN (dir . x/dir . z) 
• head=head* 1 8  0 /pi 
' m . heading=head 
'message  head 

'  Get  MobileCrane ' s  position  and  geometry  information 
m. GetTranslation  tpos 
m. GetMidpoint  tmid 
m. GetDimensions  tdim 

'  Save  MobileCrane ' s  corner  points  in  xz  plane 
tx(l) .x=tmid.x+ (tdim.x  *  0.5) 
tx(l) .y=tmid.y 

tx(l) .z=tmid.z+(tdim.z  *  0.5) 

tx (2 ) .x=tmid.x+ (tdim.x  *  0.5) 
tx(2) .y=tmid.y 

tx (2) . z=tmid. z- (tdim. z  *  0.5) 
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tx{3) .x=tmid.x- (tdim.x  *  0.5) 
tx(3) .y=tmid.y 

tx{3) .z=tmid.2+(tdim.z  *  0.5) 

tx (4) .x=tmid.x- (tdim.x  *  0.5) 
tx (4) .y=tmid.y 

tx (4) . z=tmid. z- (tdim. z  *  0.5) 

Set  startnode=GetNode ( "Root- 1 " ) 

'  Initialize  direction  vector  for  rayintersect 
p2.X=0.0 
p2.Y=1.0 
p2.Z=0.0 
num=0 . 0 

For  i=l  to  4 

tx(i) .y=tx(i) .y-m. radius 

poly (i) =RayIntersect (startnode,  tx(i) ,  p2,  geom,  height) 
If  geom  is  not  nothing  Then 

distance (i) =height 

sum=sum+distance (i) 

f oundgeom { i ) =True 

num=num+l 

End  If 

Next  i 

If  num>0.0  Then  height=sum/num 

If   (height  >  0)  Then 

m. Translate  0 , height-m. radius- (tdim. y/3) ,0 

End  If 

If  (f oundgeom (1)  and  f oundgeom (2)  and  f ovindgeom ( 3 )  )  Then 
pitch=ATN( (distance (2) -distance (1) ) /tdim. z) 
roll=ATN( (distance (1) -distance (3) ) /tdim.x) 
OrientSet  q,pitch*180 . 0 /pi, m. heading, roll*180 . 0/pi 
m. SetRotation  q 

End  If 


End  Sub 
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'  This  Task_Module  is  for  the  Truck  Equipment 

'  And  it  includes  the  Truck  Terrain- following  algorithm 

Public  which_machine  as  String 

Public  accel  as  Single 

Public  visual  as  Boolean 

Sub  Task  (m  as  Truck) 

Dim  f  as  SerialJoystick 
Dim  eng  as  Sound 
Dim  e2  as  Sound 
Dim  e3  as  Sound 
Dim  t (4)   as  Tire 
Dim  r  as  Machine 
Dim  kb  as  Keyboard 
Dim  accel  as  Single 
Dim  rot  as  Single 

Set  f=GetSerialJoystick( "Serial  Joystick-1") 
Set  eng=GetSound{"Sound-3") 
Set  e2=GetSound{"Sound-2") 
Set  e3=GetSound{"So\ind-4") 

call  terrain_fol lowing 

'  Getting  handle  for  Truck  Tires 
Set  t (1) =GetTire ("front-left-truck-tire") 
Set  t (2) =GetTire ("front-right-truck-tire") 
Set  t (3) =GetTire ( "back-left-truck-tire" ) 
Set  t (4) =GetTire ("back-right-truck-tire") 

'  Getting  handle  for  Truck  Control  parts 

Set  m=GetTruck(" truck- 1") 

Set  r=GetMachine ( "truck-upper" ) 


'  Get  keyboard  handle  for  getting  inputs 
Set  kb=GetKeyboard ( "Keyboardlnput " ) 

If  kb.Key="k"  Then 

. If  visual=True  Then 

call  right_move 

Else 

m. Rotate  y_axis,  5 

End  If 
Elself  kb.Key="j"  Then 

If  visual =True  Then 
call  left_move 

Else 

m. Rotate  y_axis,  -5 

End  If 
Elself  kb.Key=  "i"  Then 

m. Acceleration=m. Acceleration+5 


f . Sensitivity=m . Acceleration 
Elself  kb.Key="s"  Then 

eng . Playing=True 
Elself  kb.Key="m"  Then 

m . Acceleration=m . Acceleration- 5 

f . Sensitivity=m. Acceleration 
Elself  kb.Key="l"  Then 

r . PitchParent  -5 
Elself  kb.Key="0"  Then 

r. PitchParent  5 

End  If 


If  f .MiscData  and  SERJOY  TOPDOWN  Then 


Elself  f. MiscData  and  SERJOY_HATUP  Then 

r. PitchParent  -1 
Elself  f .MiscData  and  SERJOY_HATDOWN  Then 

r . PitchParent  1 
Elself  f .MiscData  and  SERJOY_TRIGGERDOWN  Then 

m . Acceleration=m . Acceleration+5 

f . Sensitivity=m. Acceleration 
Elself  f .MiscData  and  SERJOY_SIDEDOWN  Then 

m . Acceleration=m . Acceleration- 5 

f . Sensitivity=m. Acceleration 
Elself  f. MiscData  and  SERJOY_BOTTOMDOWN  Then 

call  terrain_fol lowing 

End  If 


' increase  speed 
accel=m. Acceleration 
m. Translate  0,0,accel 

'adjust  wheel  rotation  to  truck  speed 
rot=ABS (accel) 
Select  Case  accel 
Case  is=0 

'message  "truck  stopped" 
e2 . Playing=False 
e2 . Repeat=False 
Case  is>0 

For  i=l  to  4 

t (i) .Pitch  -rot 
e2 . Playing=True 
e2 . Repeat=True 

Next  i 
Case  is<0 

For  i=l  to  4 

t(i) .Pitch  rot 


e2 . Playing=True 
e2 . Repeat =True 

Next  i 

End  Select 
End  Sub 


Sub  right_move 

Dim  V  as  Viewpoint 

Set  v=GetViewpoint ( "machine_view" ) 

Dim  m  as  Truck 

Dim  m_pos  as  Vect3d 

Dim  m_ori  as  Orientation 

set  m=GetTruck {which_machine) 

m. GetTranslation  m_pos 

m.GetRotation  m_ori 

m.Yaw  5 

m . Heading=m . Heading+5 
V. SetPosition  m_pos 
V. Rotate  y_axis,  5 
End  Sub 

Sub  left_move 

Dim  V  as  Viewpoint 

Set  v=GetViewpoint ( "machine_view" ) 

Dim  m  as  Truck 

Dim  m_pos  as  Vect3d 

Dim  m_ori  as  Orientation 

Set  m=GetTruck {which_machine) 

m. GetTranslation  m_pos 

m.Yaw  -5 

m . Heading=m . Heading- 5 
V. SetPosition  m_pos 
V. Rotate  y_axis,  -5 
End  Sub 

Sub  terrain_f ollowing 
Dim  m  as  Truck 
Set  m=GetTruck{"truck-l") 
Dim  debug  as  Boolean 
debug=False 

Dim  distance (4)   as  Single 

Dim  tx(4)   as  Vect3d 

Dim  startnode  as  Node 

Dim  p2  as  Vect3d 

Dim  poly (4)   as  Long 

Dim  foundgeom(4)   as  Boolean 

Dim  geom  as  Geometry 

Dim  height  as  Single 

Dim  tdim  as  Vect3d 

Dim  tmid  as  Vect3d 


Dim  tpos  as  Vect3d 
Dim  sum  as  Single 
Dim  num  as  Single 
Dim  pitch  as  Single 
Dim  roll  as  Single 
Dim  q  as  Orientation 
Dim  ori  as  Orientation 
Dim  dir  as  Vect3d 
Dim  head  as  Single 


'  Get  Truck's  orientation 
m.GetRotation  ori 
OrientToDir  ori, dir 
dir .y=0 

DirToOrient  dir, ori 
Vect3dNorm  dir 
head=ATN(dir .x/dir . z) 
If  dir.x<0  and  dir.z>0  Then 

head=head* 18  0 /pi 
Elself  dir.x<0  and  dir.z<0  Then 

head=head* 1 8  0 /pi 

head=head+180 
Elself  dir.x<0  and  dir.z>0  Then 

head=head* 1 8  0 /pi 

head=head+180 
Elself  dir.x>0  and  dir.z<0  Then 

head=head* 1 8  0 /pi 

head=head+180 

Else 

Exit  Sub 

End  If 


'  Get  Truck's  position  and  geometry  informat 
m. GetTranslation  tpos 
m. GetMidpoint  tmid 
m.GetDimensions  tdim 


Save  Truck's  corner  points  in  xz  plane 


tx(l) 

.x=tmid 

x+ (tdim 

x*0 

5) 

tx(l) 

.y=tmid 

y 

tx(l) 

. z=tmid 

z+ (tdim 

z*0 

5) 

tx(2) 

.x=tmid 

x+ (tdim.x*0 

5) 

tx(2) 
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y 

tx(2) 
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z- (tdim 

z*0 

5) 

tx(3) 

.x=tmid 

X- (tdim 

x*0 

5) 
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.y=tmid 

y 

tx(3) 

. z=tmid 

z+ (tdim 
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5) 

tx(4) 
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X- (tdim 

x*0 

5) 

tx{4) 

.y=tmid 

y 

tx(4) 

. z=tmid 

z- (tdim 

z*0 

5) 

Set  startnode=GetNode ( "Root-1" ) 


p2.X=0.0 

p2.Y=1.0 
p2.Z=0.0 
num=0 . 0 


For  i=l  to  4 

tx(i) .y=tx(i) .y-m. Radius 

poly (i) =RayIntersect (startnode, tx (i) ,p2 , geom, height) 
If  geom  is  not  nothing  Then 

distance (i) =height/l 

sum=sum+di stance (i) 

f oundgeom ( i ) =True 

num=num+l 

End  If 

Next  i 


If  num>0.0  Then  height=sum/num 

If   (height >0)  Then 

m. Translate  0, height -m. radius- {tdim.y/2 .25) , 0 

End  If 


If  ( f oundgeom ( 1 )  and  f oundgeom (2)  and  f oundgeom { 3 ) )  Then 
pitch=ATN{ (distance (2) -distance (1) ) /tdim. z) 
roll=ATN( (distance (1) -distance (3) ) /tdim.x) 
OrientSet  q,pitch*180 . 0/pi , head, roll*180 . 0/pi 

End  If 

m. SetRotation  q 


End  Sub 


'This  Task_Module  is  to  let  the  Truck  equipment 
'detects  the  location  of  the  target  object 
'so  it  can  adjust  its  orientation  to  it 
Sub  Task  (t  as  Truck) 

Dim  job  as  Script 

Set  job=GetScript ( "truck_going_to_targetscript") 
Dim  job2  as  Script 

Set  job2=GetScript ( "truck_move_awayscript" ) 

Dim  tr  as  Tree 

Set  tr=GetTree ("tree-1") 

Dim  bldng  as  Building 

Set  bldng=GetBuilding ( "building- 1 " ) 

Dim  m  as  Material 

Set  m=GetMaterial (t .goingto) 

Dim  t_o  as  Orientation 

Dim  tpos  as  Vect3d 

Dim  mo  as  Orientation 

Dim  mpos  as  Vect3d 

t . GetTranslation  tpos 

m.GetTranslation  mpos 

Dim  diff  as  Vect3d 

Vect3dS\ibtract  mpos,  tpos ,  diff 

DirToOrient  diff,t_o 

t_o.x=0 

t_o. z=0 

t . SetRotation  t_o 
t. Translate  0,0,10 
Dim  ti  (4)   as  tire 

Set  ti (1) =GetTire ("front-left-truck-tire") 
Set  ti (2) =GetTire ("front-right-truck-tire") 
Set  ti (3) =GetTire ("back-left-truck-tire") 
Set  ti (4) =GetTire ("back-right-truck-tire") 
For  i=l  to  4 

ti (i) .Pitch  -20 

Next  i 

If  t . IntersectsMovable (tr)  Then 

MsgBox  "truck  is  bumping  into  a  tree," 
MsgBox  "trying  to  find  it's  new  path..." 
t . RemoveTask  j  ob 
t.AddTask  job2 
Set  t.Job=job2 

End  If 

If  t . IntersectsMovable (bldng)  Then 

MsgBox  "truck  is  bumping  into  a  building," 
MsgBox  "trying  to  find  it's  new  path..." 
t. RemoveTask  job 
t.AddTask  job2 
Set  t.Job=job2 

End  If 

If  t . IntersectsMovable (m)  Then 

MsgBox  "truck  reached  target..." 
t. RemoveTask  job 


End  If 
End  Svib 


'This  Task_Module  is  to  make  the  Truck  equipment 
'move  away  from  the  obstacle 
Public  auto_flag  as  String 
Public  auto_machine  as  String 
Public  truck_target  as  String 

Sub  Task  (t  as  Truck) 

Set  t=GetTruck (auto_machine) 
Dim  job  as  Script 

Set  j  ob=GetScr ipt ( " truck_move_awayscript " ) 
Dim  job2  as  Script 

Set  job2=GetScript { "truck_rotate_f romscript"  1 
t. Translate  0,0,-50 
t.RemoveTask  job 
t.AddTask  job2 
Set  t.Job=job 
End  Sub 


'This  Task_Module  is  to  make  the  tRUCK  equipment 
'move  far  enough  from  the  obstacle 
Public  auto_flag  as  String 
Public  auto_machine  as  String 
Public  truck_target  as  String 

Sub  Task(t  as  Truck) 

Set  t=GetTruck {auto_machine) 
Dim  job  as  Script 

Set  job=GetScript ( "truck_move_f arscript" ) 
Dim  job2  as  Script 

Set  job2=GetScript ( "truck_going_to_targetscript" ) 
t. Translate  0,0,300 
t.RemoveTask  job 
t.AddTask  job2 
Set  t.Job=job2 
End  Svib 


'This  Task_Module  is  to  make  the  tRUCK  equipment 
'rotate  90  degrees  to  adjust  its  motion  vector 

Public  auto_flag  as  String 
Public  auto_machine  as  String 
Pxiblic  truck_target  as  String 

Sub  Task(t  as  Truck) 

Set  t=GetTruck (auto_machine) 
Dim  job  as  Script 

Set  job=GetScript ("truck_rotate_fromscript" ) 
Dim  job2  as  Script 

Set  job2=GetScript ( "truck_move_f arscript" ) 
t. Rotate  y_axis,  90 
t.RemoveTask  job 
t.AddTask  job2 
Set  t.Job=job2 
End  Sub 


'Main  Task_Module  for  the  Tower  Crane  equipment 

Public  accel  as  Single 

Public  visual  as  Boolean 

Sub  Task  (m  as  TowerCrane) 
Dim  V  as  Viewpoint 
Set  v=GetViewpoint ( "viewpoint-1") 
'  Getting  handle  for  Tower  Crane  Control  parts 
Set  m=GetTowerCrane ( " TowerCrane - 1 " ) 
'  Getting  handle  for  Tower  Crane  Vertical  part 
Dim  r  as  Machine 

Set  r=GetMachine { "Tower_Crane-ring" ) 
Dim  g  as  Machine 

Set  g=GetMachine ( "Tower_Crane-Graber" ) 
Dim  kb  as  Keyboard 

Set  kb=GetKeyboard ( " Keyboardlnput " ) 
If  kb.Key  ="k"  Then 

If  visual =True  Then 

Call  right_move 

Else 

r.Yaw  5 

End  If 
Elself  kb.Key="j"  Then 

If  visual=True  Then 
Call  left_move 

Else 

r.Yaw  -5 

End  If 
Elself  kb.Key="l"  Then 

g. Translate  5,0,0 
Elself  kb.Key="0"  Then 


g. Translate  -5,0,0 

End  If 
End  Sub 


Sub  right_move 

Dim  r  as  Machine 

Set  r=GetMachine ( "Tower_Crane-ring" ) 
Dim  V  as  Viewpoint 
Set  v=GetViewpoint ( "viewpoint- 1" ) 
V. Rotate  y_axis, (5*PI/180) 
r.Yaw  5 
End  Sub 


Svib  left_move 

Dim  r  as  Machine 

Set  r=GetMachine ( "Tower_Crane-ring" ) 

Dim  V  as  Viewpoint 

Set  v=GetViewpoint ( "viewpoint- 1" ) 

V. Rotate  y_axis, - (5*PI/180) 

r.Yaw  -5 

End  Sub 


APPENDIX  B 

SIMCON'S  MODELS  /  SCRIPTING  CODE  FILE  STRUCTURE 


C:\ 


Naji 


PhD 


Case-study  (script  modules  are  included  in  this  directory) 


sounds 


Textures 


building-comp 
^Excv 
^site 

crane 
_^  Terrain 


Tower_crane 
Truck 
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APPENDIX  C 
HARDWARE  DEVICES  TO  BE  USED  WITH  SIMCON 


Hardware 


Serial  Joystick,  THRUSTMASTER) 
^  OpenGL  Graphics  Accelerator  Board  .GLMax  88T 


Head-Mount-Display  -HMD,  i-o  glasses) 


Software 


AutoCAD  R.  13c4 


WorldUp  R.  3.0 


WorldUp  by  SenseS  Corporation. 
GLMax  881  by  MAXVISION. 
1-0  glasses  by  virtual  i-o. 
AutoCAD  by  Autodesk. 
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